00000001:02000400:2.0F:1787582789.055788:0:3305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787582808.978608:0:3530:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1787582810.815604:0:3593:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 527 MB/s 00000001:01000000:2.0:1787582811.066245:0:3593:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 760 MB/s 00000001:01000000:2.0:1787582811.315945:0:3593:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4135 MB/s 00000020:02000000:3.0F:1787582812.346601:0:3622:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_g8672ae7 00000400:02000000:0.0:1787582813.339790:0:3636:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.111@tcp [8/256/0/180] 00008000:02000000:1.0:1787582817.014118:0:3786:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787582880.409592:0:5754:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787582894.242157:0:6504:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787582894.242165:0:6504:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1787582894.242167:0:6504:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787582894.243510:0:6504:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c058accc 00000080:02000400:1.0:1787582894.243526:0:6504:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787582894.259803:0:6504:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787582894.259816:0:6504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787582894.259883:0:6504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000005e41d5a4) 00000020:00000080:1.0:1787582894.259904:0:6504:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787582894.371803:0:6504:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787582894.371911:0:6504:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1787582894.409560:0:6504:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787582894.409818:0:6504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787582894.409828:0:6504:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787582894.409839:0:6504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b5c74 00000020:01000004:0.0:1787582894.409890:0:6504:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787582894.409896:0:6504:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787582894.409902:0:6504:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c058accc from MGS 00000020:01000004:0.0:1787582894.409907:0:6504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787582894.410090:0:6504:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000000a3f892f) 00000020:00000080:0.0:1787582894.410103:0:6504:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787582894.410228:0:6504:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c058accc from MGS, refs=2 00080000:01000000:0.0:1787582894.410234:0:6504:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787582894.410239:0:6504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b5c82 00000100:00100000:0.0:1787582894.410408:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787582894.410542:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787582894.410549:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787582894.411210:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787582894.411218:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787582894.412625:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582894.412812:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787582894.412818:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787582894.413531:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787582894.413540:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787582894.418603:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787582894.418621:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787582894.419226:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582894.419230:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582894.419232:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582894.419505:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582894.419507:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582894.419509:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582894.420043:0:6504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787582894.421445:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787582894.670028:0:6504:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2643 MB/s 00000001:01000000:2.0:1787582894.921702:0:6504:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3258 MB/s 00000001:01000000:2.0:1787582895.172365:0:6504:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 661 MB/s 00000001:01000000:3.0:1787582895.422308:0:6504:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 607 MB/s 00010000:00010000:0.0:1787582895.439125:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787582895.441092:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1787582895.459324:0:6504:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787582895.462234:0:6519:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787582895.462306:0:6504:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787582895.462375:0:6504:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787582895.462669:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787582895.462705:0:6504:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787582895.463823:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787582895.464084:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787582895.464091:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787582895.466439:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787582895.466453:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787582895.467175:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787582895.467182:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787582895.468054:0:6504:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787582895.468082:0:6504:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.111@tcp' 00000020:01000004:0.0:1787582895.468084:0:6504:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787582895.468159:0:6504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.111@tcp (typ=mgc) 00000020:00000080:0.0:1787582895.468174:0:6504:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.111@tcp (00000000be853418) 00000020:00000080:0.0:1787582895.468205:0:6504:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787582895.468290:0:6504:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000092dc932d@MGC192.168.203.111@tcp: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1787582895.468481:0:6504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.111@tcp-0 is initialized 00000040:01000000:0.0:1787582895.468489:0:6504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787582895.471424:0:6523:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787582895.476625:0:6525:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787582895.476730:0:6504:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.111@tcp (uuid 5bddce63-0a65-4d1b-a395-d8312cc42532) 00000020:00000080:3.0:1787582895.476759:0:6504:0:(genops.c:1385:class_connect()) connect: client 5bddce63-0a65-4d1b-a395-d8312cc42532, cookie 0x19a47956376b5c90 00000100:00080000:3.0:1787582895.476774:0:6504:0:(import.c:510:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787582895.476789:0:6504:0:(import.c:624:import_select_connection()) MGC192.168.203.111@tcp: import 0000000092dc932d using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787582895.480707:0:6504:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005d56721c x1874416435724416/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787582895.480752:0:6504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS 00000020:01000004:3.0:1787582895.480781:0:6504:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787582895.480790:0:6504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787582895.480822:0:6504:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005c0808ff) 00000020:00000080:3.0:1787582895.480840:0:6504:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787582895.480936:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d56721c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5bddce63-0a65-4d1b-a395-d8312cc42532:3652:1874416435724416:0@lo:250: 00000100:00100000:0.0:1787582895.481060:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582895.481155:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435724416 00000100:00100000:0.0:1787582895.481164:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435724416 00000100:00100000:0.0:1787582895.481214:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787582895.481220:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a773a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3652:x1874416435724416:12345-0@lo:250: 00010000:00080000:0.0:1787582895.481245:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5bddce63-0a65-4d1b-a395-d8312cc42532@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1787582895.481273:0:6520:0:(genops.c:1385:class_connect()) connect: client 5bddce63-0a65-4d1b-a395-d8312cc42532, cookie 0x19a47956376b5c9e 00000100:00080000:0.0:1787582895.481430:0:6520:0:(import.c:65:import_set_state_nolock()) 00000000085679df : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787582895.481486:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a773a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:3652:x1874416435724416:12345-0@lo:250: Request processed in 265us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582895.481493:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787582895.481526:0:3652:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787582895.481532:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:0.0:1787582895.481539:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787582895.481543:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787582895.481546:0:3652:0:(import.c:65:import_set_state_nolock()) 0000000092dc932d MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787582895.481548:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787582895.491397:0:3652:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787582895.491417:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d56721c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5bddce63-0a65-4d1b-a395-d8312cc42532:3652:1874416435724416:0@lo:250: 00000100:00100000:3.0:1787582895.510126:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582895.510347:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787582895.510354:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787582895.512399:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787582895.512413:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787582895.517377:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787582895.517392:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787582895.518644:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582895.519032:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787582895.519039:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787582895.519692:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787582895.519706:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787582895.640631:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582895.640900:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787582895.640915:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787582895.645439:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787582895.645459:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787582895.648324:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787582895.648610:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787582895.648617:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787582895.649776:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787582895.649787:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787582895.650705:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787582895.650948:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787582895.650954:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787582895.654743:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787582895.654760:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787582895.655518:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787582895.655789:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787582895.655795:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787582895.656486:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787582895.656494:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787582895.685205:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787582895.685479:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787582895.685487:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787582895.687293:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787582895.687308:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787582895.704898:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787582895.704926:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787582895.708084:0:6504:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787582895.708300:0:6504:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787582895.708307:0:6504:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787582895.708579:0:6504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787582895.708619:0:6504:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787582895.708623:0:6504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787582895.708625:0:6504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787582895.708627:0:6504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582895.708628:0:6504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582895.708629:0:6504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582895.708631:0:6504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582895.708633:0:6504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787582895.708635:0:6504:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787582895.708636:0:6504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787582895.708637:0:6504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787582895.708639:0:6504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582895.708640:0:6504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787582895.708643:0:6504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787582895.708645:0:6504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787582895.708646:0:6504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787582895.708647:0:6504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582895.708648:0:6504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582895.708653:0:6504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582895.708654:0:6504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582895.708655:0:6504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787582895.708656:0:6504:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787582895.708656:0:6504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787582895.708657:0:6504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787582895.708658:0:6504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582895.708658:0:6504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787582895.708711:0:6504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787582895.708731:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c4584f87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435724544:0@lo:253: 00000100:00100000:2.0:1787582895.708826:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582895.708965:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2b4fb75 going to sleep for 11 seconds 00000100:00100000:1.0:1787582895.709249:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435724544 00000100:00100000:1.0:1787582895.709260:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435724544 00000100:00100000:1.0:1787582895.709317:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582895.709327:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c9b8d5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+5:6504:x1874416435724544:12345-0@lo:253: 20000000:01000000:1.0:1787582895.709386:0:6522:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787582895.709389:0:6522:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787582895.716472:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787582895.716546:0:6522:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787582895.716954:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787582895.718022:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787582895.722288:0:6522:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787582895.722312:0:6522:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787582895.722318:0:6522:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787582895.722322:0:6522:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787582895.722337:0:6522:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787582895.722560:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582895.722715:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787582895.722730:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787582895.722746:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787582895.722760:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787582895.722773:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787582895.723565:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787582895.723579:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787582895.723594:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787582895.723600:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787582895.723611:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787582895.723616:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787582895.723628:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787582895.723644:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787582895.723675:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787582895.723681:0:6522:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787582895.723689:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582895.724233:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787582895.724248:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787582895.724264:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787582895.724281:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787582895.724316:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787582895.724328:0:6522:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787582895.724356:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787582895.724363:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787582895.724376:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787582895.724392:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787582895.724408:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787582895.724427:0:6522:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787582895.724455:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787582895.724463:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787582895.724477:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787582895.724493:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787582895.724552:0:6522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787582895.724574:0:6522:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787582895.724582:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787582895.726244:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787582895.726515:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787582895.726539:0:6522:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.111@tcp for mdt 20000000:01000000:0.0:1787582895.726542:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:0.0:1787582895.726554:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787582895.726559:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787582895.726569:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787582895.726574:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:0.0:1787582895.726583:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787582895.726589:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787582895.726599:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787582895.726610:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787582895.726637:0:6522:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787582895.726639:0:6522:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787582895.726643:0:6522:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787582895.726703:0:6522:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787582895.726718:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787582895.727417:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787582895.727596:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787582895.727618:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787582895.727632:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1787582895.727641:0:6522:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787582895.727643:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787582895.728412:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787582895.728592:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787582895.728614:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787582895.728629:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787582895.728643:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787582895.728646:0:6522:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787582895.728650:0:6522:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787582895.728652:0:6522:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787582895.728658:0:6522:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787582895.728665:0:6522:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787582895.729262:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787582895.729370:0:6522:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787582895.742834:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1787582895.742908:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1787582895.742949:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1787582895.742987:0:6522:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787582895.743013:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5ca5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582895.743044:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5ca5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582895.743055:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5ca5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582895.743061:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5ca5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582895.743068:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5ca5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582895.743074:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5ca5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582895.743081:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000015d7ddf4 already unused, calling callback (00000000d14ff72a) 00010000:00010000:1.0:1787582895.743085:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5ca5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582895.743093:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5ca5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582895.743107:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5ca5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582895.743115:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5ca5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582895.743122:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5ca5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787582895.743153:0:6522:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787582895.772490:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c9b8d5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+5:6504:x1874416435724544:12345-0@lo:253: Request processed in 63157us (63657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582895.772518:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582895.772955:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c4584f87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435724544:0@lo:253: 10000000:01000000:3.0:1787582895.772985:0:6504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787582895.772989:0:6504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787582895.772991:0:6504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787582895.772992:0:6504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582895.772994:0:6504:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787582895.772995:0:6504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582895.772996:0:6504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582895.772997:0:6504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582895.772999:0:6504:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787582895.773000:0:6504:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787582895.773002:0:6504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582895.773004:0:6504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787582895.773027:0:6504:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c058accc from lustre-MDT0000 10000000:01000000:3.0:1787582895.773064:0:6504:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787582895.773067:0:6504:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787582895.773071:0:6504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff909343e199b8 10000000:01000000:3.0:1787582895.773076:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787582895.773084:0:6504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff909343e199b8 from 1 10000000:01000000:3.0:1787582895.773088:0:6504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787582895.773143:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582895.773155:0:6504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582895.773165:0:6504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582895.773185:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435724672:0@lo:101: 00000100:00100000:3.0:1787582895.773231:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582895.773313:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085d10bde going to sleep for 11 seconds 00000100:00100000:0.0:1787582895.773415:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435724672 00000100:00100000:0.0:1787582895.773424:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435724672 00000100:00100000:0.0:1787582895.773478:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582895.773488:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027299b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+5:6504:x1874416435724672:12345-0@lo:101: 00010000:00010000:0.0:1787582895.773513:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582895.773530:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1279f4a/0x19a47956376b5cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5cac expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582895.773556:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1279f4a/0x19a47956376b5cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5cac expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582895.773568:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1279f4a/0x19a47956376b5cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5cac expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582895.773577:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1279f4a, rc 0) 00000100:00100000:0.0:1787582895.773625:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027299b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+6:6504:x1874416435724672:12345-0@lo:101: Request processed in 139us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582895.773631:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582895.773711:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435724672:0@lo:101: 00010000:00010000:3.0:1787582895.773725:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5cb3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582895.773734:0:6504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5cb3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582895.773802:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435724800:0@lo:501: 00000100:00100000:3.0:1787582895.773827:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582895.773870:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085d10bde going to sleep for 11 seconds 00000100:00100000:1.0:1787582895.773924:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435724800 00000100:00100000:1.0:1787582895.773930:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435724800 00000100:00100000:1.0:1787582895.773958:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582895.773965:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d32949f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+6:6504:x1874416435724800:12345-0@lo:501: 00000100:00100000:1.0:1787582895.774062:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d32949f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+6:6504:x1874416435724800:12345-0@lo:501: Request processed in 97us (234us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787582895.774069:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787582895.774216:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435724800:0@lo:501: 10000000:01000000:3.0:1787582895.774247:0:6504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787582895.774277:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5cb3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582895.774286:0:6504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5cb3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582895.774293:0:6504:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff909348740800 10000000:01000000:3.0:1787582895.774297:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787582895.774302:0:6504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff909348740800 10000000:01000000:3.0:1787582895.774304:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787582895.774307:0:6504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff909348740800 from 1 10000000:01000000:3.0:1787582895.774310:0:6504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787582895.774328:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000a995302e/0x19a47956376b5cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582895.774335:0:6504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000a995302e/0x19a47956376b5cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582895.774350:0:6504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000a995302e/0x19a47956376b5cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582895.774362:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435724928:0@lo:101: 00000100:00100000:3.0:1787582895.774388:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582895.774634:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085d10bde going to sleep for 11 seconds 00000100:00100000:0.0:1787582895.774693:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435724928 00000100:00100000:0.0:1787582895.774699:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435724928 00000100:00100000:0.0:1787582895.774738:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787582895.774745:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ac26bd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+6:6504:x1874416435724928:12345-0@lo:101: 00010000:00010000:0.0:1787582895.774753:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582895.774764:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000727cc85f/0x19a47956376b5cc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5cba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582895.774781:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000727cc85f/0x19a47956376b5cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5cba expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582895.774801:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000727cc85f/0x19a47956376b5cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5cba expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582895.774809:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000727cc85f, rc 0) 00000100:00100000:0.0:1787582895.774869:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ac26bd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+7:6504:x1874416435724928:12345-0@lo:101: Request processed in 125us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582895.774875:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787582895.775054:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435724928:0@lo:101: 00010000:00010000:3.0:1787582895.775069:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000a995302e/0x19a47956376b5cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582895.775077:0:6504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000a995302e/0x19a47956376b5cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582895.775089:0:6504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787582895.775104:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000a995302e/0x19a47956376b5cba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582895.775111:0:6504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000a995302e/0x19a47956376b5cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582895.775184:0:6504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787582895.775190:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787582895.775194:0:6504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff909348740800 10000000:01000000:3.0:1787582895.775197:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787582895.775199:0:6504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787582895.775201:0:6504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787582895.775218:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582895.775231:0:6504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582895.775238:0:6504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582895.775253:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435725056:0@lo:101: 00000100:00100000:3.0:1787582895.775391:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582895.776214:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085d10bde going to sleep for 11 seconds 00000100:00100000:0.0:1787582895.776347:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435725056 00000100:00100000:0.0:1787582895.776356:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435725056 00000100:00100000:0.0:1787582895.776448:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787582895.776458:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061121d7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+7:6504:x1874416435725056:12345-0@lo:101: 00010000:00010000:0.0:1787582895.776472:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582895.776491:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005abe5bd8/0x19a47956376b5ccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5cc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582895.776529:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005abe5bd8/0x19a47956376b5ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5cc8 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582895.776547:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005abe5bd8/0x19a47956376b5ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5cc8 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582895.776558:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005abe5bd8, rc 0) 00000100:00100000:0.0:1787582895.776617:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061121d7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+8:6504:x1874416435725056:12345-0@lo:101: Request processed in 160us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582895.776624:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582895.776711:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435725056:0@lo:101: 00010000:00010000:3.0:1787582895.776728:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5ccf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582895.776737:0:6504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5ccf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582895.776810:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435725184:0@lo:501: 00000100:00100000:3.0:1787582895.776842:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582895.778310:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085d10bde going to sleep for 11 seconds 00000100:00100000:2.0:1787582895.782981:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435725184 00000100:00100000:2.0:1787582895.783000:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435725184 00000100:00100000:2.0:1787582895.783089:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787582895.783101:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014f6578f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+8:6504:x1874416435725184:12345-0@lo:501: 00000100:00100000:2.0:1787582895.783324:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014f6578f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+9:6504:x1874416435725184:12345-0@lo:501: Request processed in 225us (6481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582895.783336:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787582895.783791:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435725184:0@lo:501: 00000100:00100000:3.0:1787582895.783922:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435725312:0@lo:503: 00000100:00100000:3.0:1787582895.783990:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582895.784033:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085d10bde going to sleep for 11 seconds 00000100:00100000:2.0:1787582895.784140:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435725312 00000100:00100000:2.0:1787582895.784146:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435725312 00000100:00100000:2.0:1787582895.784183:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787582895.784190:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002df814b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+9:6504:x1874416435725312:12345-0@lo:503: 00000100:00100000:2.0:1787582895.784293:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002df814b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+9:6504:x1874416435725312:12345-0@lo:503: Request processed in 104us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582895.784301:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787582895.784471:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435725312:0@lo:503: 00000100:00100000:3.0:1787582895.785092:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:6549:1874416435725440:0@lo:502: 00000100:00100000:3.0:1787582895.785141:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582895.785168:0:6549:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5f0a078 going to sleep for 11 seconds 00000100:00100000:2.0:1787582895.785220:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435725440 00000100:00100000:2.0:1787582895.785226:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435725440 00000100:00100000:2.0:1787582895.785306:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787582895.785314:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008302f67a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+9:6549:x1874416435725440:12345-0@lo:502: 00000100:00100000:2.0:1787582895.785418:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008302f67a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+9:6549:x1874416435725440:12345-0@lo:502: Request processed in 95us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582895.785427:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787582895.785510:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:6549:1874416435725440:0@lo:502: 00000020:01000000:3.0:1787582895.785804:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582895.785816:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582895.785819:0:6549:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787582895.785824:0:6549:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787582895.785828:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787582895.785843:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ae3c5ee6) 00000020:00000080:3.0:1787582895.785881:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787582895.785886:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787582895.785991:0:6549:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787582895.785999:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b5cdd 00000020:00000080:3.0:1787582895.786239:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787582895.786244:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582895.786247:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582895.786249:0:6549:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787582895.786251:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582895.786254:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582895.786255:0:6549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787582895.786259:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787582895.786266:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000094f58fd4) 00000020:00000080:3.0:1787582895.786277:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787582895.786281:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787582895.786283:0:6549:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787582895.786285:0:6549:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787582895.786291:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787582895.786332:0:6549:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c058accc from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787582895.786345:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ad5821c8) 00000020:00000080:3.0:1787582895.786353:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787582895.786447:0:6549:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787582895.786458:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b5cf2 00000020:00000080:3.0:1787582895.786797:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787582895.786804:0:6549:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787582895.786809:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x19a47956376b5cf9 00080000:01000000:3.0:1787582895.786815:0:6549:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787582895.786818:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b5d00 00080000:10000000:3.0:1787582895.787288:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1787582895.787469:0:6549:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787582895.801083:0:6549:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787582895.964145:0:6549:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787582895.964751:0:6549:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787582895.971281:0:6549:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787582895.971732:0:6549:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787582895.977928:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e7ff828a) 00000020:00000080:3.0:1787582895.977955:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787582895.978068:0:6549:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787582895.978077:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b5d0e 00000020:00000080:0.0:1787582895.979296:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787582895.983023:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1787582895.993933:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1787582896.005417:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1787582896.015126:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1787582896.024136:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1787582896.028430:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1787582896.035204:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x19a47956376b5d15 00000020:00000080:0.0:1787582896.036736:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787582896.036750:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582896.036758:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582896.036761:0:6549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787582896.036764:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582896.036768:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582896.036769:0:6549:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787582896.036772:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787582896.036774:0:6549:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787582896.036777:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582896.036779:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582896.036780:0:6549:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787582896.036783:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582896.036787:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582896.036789:0:6549:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787582896.036793:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787582896.037692:0:6549:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787582896.037808:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2264194 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:6549:1874416435725568:0@lo:502: 00000100:00100000:1.0:1787582896.041805:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582896.041979:0:6549:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c68b76e going to sleep for 11 seconds 00000100:00100000:2.0:1787582896.046938:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435725568 00000100:00100000:2.0:1787582896.047033:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435725568 00000100:00100000:2.0:1787582896.047218:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787582896.047230:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050e65233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+9:6549:x1874416435725568:12345-0@lo:502: 00000100:00100000:2.0:1787582896.047501:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050e65233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+9:6549:x1874416435725568:12345-0@lo:502: Request processed in 273us (5704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582896.047510:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787582896.047785:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2264194 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:6549:1874416435725568:0@lo:502: 00000020:01000000:1.0:1787582896.047827:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582896.047834:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582896.047837:0:6549:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787582896.047842:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787582896.048144:0:6504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787582896.048168:0:6504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787582896.048197:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5ccf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582896.048210:0:6504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5ccf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582896.048233:0:6504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff909348740800 from 1 10000000:01000000:0.0:1787582896.048236:0:6504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787582896.048347:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582896.048355:0:6504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582896.048366:0:6504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582896.048388:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000932a91d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435725696:0@lo:101: 00000100:00100000:0.0:1787582896.048436:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582896.048550:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 000000007cf9f180 going to sleep for 11 seconds 00000100:00100000:2.0:1787582896.048813:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435725696 00000100:00100000:2.0:1787582896.048821:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435725696 00000100:00100000:2.0:1787582896.048885:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787582896.048892:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f44ac496 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+9:6504:x1874416435725696:12345-0@lo:101: 00010000:00010000:2.0:1787582896.048905:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582896.048923:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d963ea18/0x19a47956376b5d23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582896.048946:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d963ea18/0x19a47956376b5d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5d1c expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582896.048977:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d963ea18/0x19a47956376b5d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5d1c expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582896.049002:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d963ea18, rc 0) 00000100:00100000:2.0:1787582896.049045:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f44ac496 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+10:6504:x1874416435725696:12345-0@lo:101: Request processed in 154us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582896.049051:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787582896.049496:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000932a91d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435725696:0@lo:101: 00010000:00010000:1.0:1787582896.049512:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d23 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.049520:0:6504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5d23 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582896.051539:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048d97f57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435725824:0@lo:256: 00000100:00100000:1.0:1787582896.051643:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582896.051694:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fe46ba9b going to sleep for 11 seconds 00000100:00100000:1.0:1787582896.051727:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435725824 00000100:00100000:1.0:1787582896.051735:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435725824 00000100:00100000:1.0:1787582896.051777:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787582896.051785:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee9d1bdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+10:6504:x1874416435725824:12345-0@lo:256: 20000000:01000000:1.0:1787582896.051808:0:6522:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787582896.051815:0:6522:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787582896.051939:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee9d1bdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+10:6504:x1874416435725824:12345-0@lo:256: Request processed in 154us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582896.052129:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048d97f57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435725824:0@lo:256: 10000000:01000000:0.0:1787582896.052715:0:6504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787582896.052738:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d23 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582896.052751:0:6504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d23 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582896.052761:0:6504:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff909348740800 from 1 10000000:01000000:0.0:1787582896.052764:0:6504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787582896.052804:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582896.052811:0:6504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582896.052830:0:6504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582896.052880:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435725952:0@lo:101: 00000100:00100000:0.0:1787582896.052928:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582896.053121:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787582896.053166:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435725952 00000100:00100000:1.0:1787582896.053172:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435725952 00000100:00100000:1.0:1787582896.053198:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787582896.053205:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9405c60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+10:6504:x1874416435725952:12345-0@lo:101: 00010000:00010000:1.0:1787582896.053217:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582896.053231:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5d31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5d2a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.053318:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5d2a expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.053330:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5d2a expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.053340:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000015d7ddf4, rc 0) 00000100:00100000:1.0:1787582896.053372:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9405c60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+11:6504:x1874416435725952:12345-0@lo:101: Request processed in 167us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582896.053378:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787582896.053443:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f26fbfff going to sleep for 11 seconds 00000100:00100000:0.0:1787582896.053464:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435725952:0@lo:101: 00010000:00010000:0.0:1787582896.053476:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d31 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582896.053484:0:6504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5d31 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582896.053546:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435726080:0@lo:501: 00000100:00100000:0.0:1787582896.053574:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582896.053596:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f26fbfff going to sleep for 11 seconds 00000100:00100000:0.0:1787582896.053623:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435726080 00000100:00100000:0.0:1787582896.053627:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435726080 00000100:00100000:0.0:1787582896.053647:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787582896.053653:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d2da679 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+11:6504:x1874416435726080:12345-0@lo:501: 00000100:00100000:0.0:1787582896.053816:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d2da679 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+11:6504:x1874416435726080:12345-0@lo:501: Request processed in 163us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582896.053823:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787582896.053905:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435726080:0@lo:501: 00000100:00100000:0.0:1787582896.053932:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435726208:0@lo:503: 00000100:00100000:0.0:1787582896.054211:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582896.054240:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f26fbfff going to sleep for 11 seconds 00000100:00100000:3.0:1787582896.054393:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435726208 00000100:00100000:3.0:1787582896.054400:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435726208 00000100:00100000:3.0:1787582896.054502:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787582896.054510:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025cc722f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+11:6504:x1874416435726208:12345-0@lo:503: 00000040:00080000:3.0:1787582896.054550:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787582896.054602:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025cc722f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+11:6504:x1874416435726208:12345-0@lo:503: Request processed in 93us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582896.054608:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787582896.054811:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435726208:0@lo:503: 00000040:00080000:0.0:1787582896.056166:0:6553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787582896.056336:0:6504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787582896.056364:0:6504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787582896.056383:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d31 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.056395:0:6504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d31 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582896.056454:0:6504:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787582896.056458:0:6504:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff909348740800 10000000:01000000:1.0:1787582896.056461:0:6504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff909348740800 10000000:01000000:1.0:1787582896.056465:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787582896.056471:0:6504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff909348740800 from 1 10000000:01000000:1.0:1787582896.056473:0:6504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787582896.056515:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.056523:0:6504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.056534:0:6504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582896.056556:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000977bd606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435726336:0@lo:101: 00000100:00100000:1.0:1787582896.056616:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582896.056651:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf805f7a going to sleep for 11 seconds 00000100:00100000:3.0:1787582896.056791:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435726336 00000100:00100000:3.0:1787582896.056799:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435726336 00000100:00100000:2.0:1787582896.057124:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787582896.057134:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e9ccd12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+11:6504:x1874416435726336:12345-0@lo:101: 00010000:00010000:2.0:1787582896.057150:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582896.057163:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b51778c2/0x19a47956376b5d3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5d38 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582896.057189:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b51778c2/0x19a47956376b5d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5d38 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582896.057199:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b51778c2/0x19a47956376b5d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5d38 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582896.057210:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b51778c2, rc 0) 00000100:00100000:0.0:1787582896.057354:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000977bd606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435726336:0@lo:101: 00010000:00010000:0.0:1787582896.057370:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d3f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582896.057379:0:6504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5d3f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582896.057438:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435726464:0@lo:501: 00000100:00100000:0.0:1787582896.057527:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582896.057587:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01f9d37 going to sleep for 11 seconds 00000100:00100000:2.0:1787582896.057883:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e9ccd12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6504:x1874416435726336:12345-0@lo:101: Request processed in 710us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582896.057891:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787582896.057922:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435726464 00000100:00100000:2.0:1787582896.057927:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435726464 00000100:00100000:1.0:1787582896.058207:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787582896.058217:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1371360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6504:x1874416435726464:12345-0@lo:501: 00000100:00100000:1.0:1787582896.058449:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1371360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6504:x1874416435726464:12345-0@lo:501: Request processed in 234us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582896.058472:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787582896.058544:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435726464:0@lo:501: 00000100:00100000:0.0:1787582896.058585:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435726592:0@lo:503: 00000100:00100000:0.0:1787582896.058628:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582896.058657:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01f9d37 going to sleep for 11 seconds 00000100:00100000:1.0:1787582896.058700:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435726592 00000100:00100000:1.0:1787582896.058705:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435726592 00000100:00100000:1.0:1787582896.058726:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787582896.058732:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4acb10b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6504:x1874416435726592:12345-0@lo:503: 00000100:00100000:1.0:1787582896.058814:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4acb10b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6504:x1874416435726592:12345-0@lo:503: Request processed in 82us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582896.058820:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787582896.058930:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435726592:0@lo:503: 00000100:00100000:0.0:1787582896.059814:0:6554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:6554:1874416435726720:0@lo:502: 00000100:00100000:0.0:1787582896.059895:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582896.059926:0:6554:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0921c2b going to sleep for 11 seconds 00000100:00100000:1.0:1787582896.060213:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435726720 00000100:00100000:1.0:1787582896.060221:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435726720 00000100:00100000:1.0:1787582896.060330:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787582896.060340:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000457fc0ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6554:x1874416435726720:12345-0@lo:502: 00000100:00100000:1.0:1787582896.060463:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000457fc0ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6554:x1874416435726720:12345-0@lo:502: Request processed in 125us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582896.060470:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787582896.060554:0:6554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:6554:1874416435726720:0@lo:502: 00000020:01000004:0.0:1787582896.060619:0:6554:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787582896.060635:0:6554:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b3f7848f) 00000020:00000080:0.0:1787582896.060661:0:6554:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787582896.060763:0:6554:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c058accc from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787582896.060768:0:6554:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c058accc from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787582896.060770:0:6554:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c058accc 4 00010000:00080000:0.0:1787582896.060804:0:6554:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000060108e12@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1787582896.063370:0:6554:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787582896.063590:0:6554:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787582896.063638:0:6554:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787582896.063652:0:6554:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x19a47956376b5d4d 00000100:00080000:0.0:1787582896.063662:0:6554:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787582896.063668:0:6554:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000060108e12 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1787582896.063712:0:6554:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e3126445 x1874416435726848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787582896.063757:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874416435726848:0@lo:38: 00000100:00100000:0.0:1787582896.063833:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787582896.063926:0:6554:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787582896.064247:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435726848 00000100:00100000:3.0:1787582896.064268:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435726848 00000100:00100000:3.0:1787582896.064306:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582896.064315:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d693fade pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874416435726848:12345-0@lo:38: 00000100:00100000:3.0:1787582896.064379:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d693fade pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874416435726848:12345-0@lo:38: Request processed in 63us (545us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787582896.064387:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787582896.068142:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787582896.068157:0:3652:0:(import.c:65:import_set_state_nolock()) 0000000060108e12 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787582896.068166:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787582896.068171:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874416435726848:0@lo:38: 00000100:00100000:3.0:1787582896.068685:0:6554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:6554:1874416435726976:0@lo:502: 00000100:00100000:3.0:1787582896.068777:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582896.069019:0:6554:0:(client.c:2715:ptlrpc_set_wait()) set 000000005a5e5288 going to sleep for 11 seconds 00000100:00100000:2.0:1787582896.069144:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435726976 00000100:00100000:2.0:1787582896.069155:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435726976 00000100:00100000:2.0:1787582896.069218:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787582896.069229:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbed9b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6554:x1874416435726976:12345-0@lo:502: 00000100:00100000:2.0:1787582896.069461:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbed9b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6554:x1874416435726976:12345-0@lo:502: Request processed in 232us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582896.069478:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787582896.071108:0:6554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:6554:1874416435726976:0@lo:502: 00000040:00080000:3.0:1787582896.071156:0:6554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787582896.071411:0:6504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787582896.071435:0:6504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787582896.071456:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d3f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.071467:0:6504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d3f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787582896.071521:0:6504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787582896.071523:0:6504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787582896.071524:0:6504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787582896.071526:0:6504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787582896.071527:0:6504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787582896.071532:0:6504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787582896.071534:0:6504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787582896.071536:0:6504:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787582896.071537:0:6504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787582896.071538:0:6504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787582896.071540:0:6504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787582896.071541:0:6504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787582896.071545:0:6504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787582896.071548:0:6504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787582896.071549:0:6504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787582896.071550:0:6504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787582896.071551:0:6504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787582896.071551:0:6504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787582896.071552:0:6504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787582896.071553:0:6504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787582896.071554:0:6504:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787582896.071555:0:6504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787582896.071556:0:6504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787582896.071556:0:6504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787582896.071557:0:6504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787582896.071582:0:6504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787582896.071598:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008369e10d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435727104:0@lo:253: 00000100:00100000:1.0:1787582896.071663:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582896.071705:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000053bda67 going to sleep for 11 seconds 00000100:00100000:2.0:1787582896.071755:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435727104 00000100:00100000:2.0:1787582896.071762:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435727104 00000100:00100000:2.0:1787582896.071835:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787582896.071865:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7caa45d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6504:x1874416435727104:12345-0@lo:253: 20000000:01000000:2.0:1787582896.071895:0:6521:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787582896.071908:0:6521:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787582896.083418:0:6521:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787582896.083442:0:6521:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787582896.083916:0:6543:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787582896.083923:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787582896.083960:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.083991:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d963ea18/0x19a47956376b5d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5d1c expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.084000:0:6543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.084048:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d963ea18/0x19a47956376b5d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5d1c expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.084090:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d963ea18/0x19a47956376b5d23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5d1c expref: 12 pid: 6522 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582896.084106:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025eb2646 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435727232:0@lo:104: 00000100:00100000:1.0:1787582896.084179:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582896.084229:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca4f6ac5 going to sleep for 11 seconds 00000100:00100000:3.0:1787582896.084458:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435727232 00000100:00100000:3.0:1787582896.084469:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435727232 00000100:00100000:3.0:1787582896.084528:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582896.084540:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000132f662 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6543:x1874416435727232:12345-0@lo:104: 00010000:00010000:3.0:1787582896.084555:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5d23 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582896.084622:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787582896.084628:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000132f662 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6543:x1874416435727232:12345-0@lo:104: Request processed in 91us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582896.084636:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787582896.084721:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582896.084728:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5d23 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.084735:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000006bb188a already unused, calling callback (00000000059fe3b4) 10000000:00010000:1.0:1787582896.084738:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5d23 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.084746:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5d23 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582896.084753:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5d23 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582896.084758:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582896.084792:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5d23 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.084799:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582896.084822:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5d23 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.084828:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5d1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5d23 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.084884:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582896.084886:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582896.084887:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582896.084914:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025eb2646 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435727232:0@lo:104: 00010000:00010000:1.0:1787582896.084934:0:6543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582896.085123:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003844c152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435727360:0@lo:103: 00000100:00100000:2.0:1787582896.085162:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582896.085352:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435727360 00000100:00100000:1.0:1787582896.085358:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435727360 00010000:00010000:1.0:1787582896.085378:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d963ea18/0x19a47956376b5d23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5d1c expref: 13 pid: 6522 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582896.085411:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582896.085419:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9ba0451 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:3654:x1874416435727360:12345-0@lo:103: 00010000:00010000:1.0:1787582896.085431:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582896.085436:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d963ea18/0x19a47956376b5d23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5d1c expref: 13 pid: 6522 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085446:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d963ea18/0x19a47956376b5d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5d1c expref: 13 pid: 6522 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085460:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d963ea18/0x19a47956376b5d23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5d1c expref: 13 pid: 6522 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085476:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085483:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787582896.085503:0:6512:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001581010s 00010000:00010000:1.0:1787582896.085507:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085514:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085520:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085526:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085531:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c9fe0e90 already unused, calling callback (00000000d14ff72a) 00010000:00010000:1.0:1787582896.085534:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085542:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085555:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085563:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582896.085596:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9ba0451 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:3654:x1874416435727360:12345-0@lo:103: Request processed in 178us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582896.085603:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582896.085632:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003844c152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435727360:0@lo:103: 00010000:00010000:1.0:1787582896.085650:0:6543:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085662:0:6543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582896.085667:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5d54 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582896.086154:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7caa45d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+11:6504:x1874416435727104:12345-0@lo:253: Request processed in 14311us (14491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582896.086164:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787582896.086243:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008369e10d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:6504:1874416435727104:0@lo:253: 10000000:01000000:1.0:1787582896.086327:0:6504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787582896.086332:0:6504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787582896.086334:0:6504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787582896.086336:0:6504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787582896.086337:0:6504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787582896.086338:0:6504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787582896.086340:0:6504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787582896.086341:0:6504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787582896.086343:0:6504:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787582896.086344:0:6504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787582896.086346:0:6504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787582896.086348:0:6504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787582896.086349:0:6504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787582896.086364:0:6504:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787582896.091709:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1787582896.091926:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787582896.092160:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1787582896.092294:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787582896.092514:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1787582896.092683:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787582896.096192:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1787582896.096442:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787582896.096636:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1787582896.096805:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787582896.097240:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1787582896.097478:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1787582896.101058:0:6504:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787582896.110178:0:6504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787582896.110492:0:6559:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787582896.110498:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787582896.110776:0:6560:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787582896.113127:0:6504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787582896.113243:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787582896.113742:0:6504:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787582896.113751:0:6504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787582896.114102:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582896.115630:0:6504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787582896.116447:0:6504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787582896.116503:0:6504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787582896.119608:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787582896.119887:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:1.0:1787582896.120431:0:6560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1787582896.122706:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787582896.124077:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787582896.124373:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787582896.124509:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787582896.124674:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787582896.124833:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787582896.129578:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787582896.129792:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787582896.129979:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787582896.130139:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787582896.131603:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787582896.131790:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000040:00080000:1.0:1787582896.132108:0:6560:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787582896.132178:0:6560:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787582896.132183:0:6560:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1787582896.132678:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787582896.132831:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787582896.133068:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787582896.133265:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787582896.133585:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787582896.133748:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787582896.133935:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787582896.134085:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787582896.134234:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787582896.134394:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787582896.134536:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787582896.134682:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787582896.134831:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787582896.135026:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787582896.135181:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787582896.135310:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787582896.135448:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787582896.135602:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787582896.135740:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787582896.135911:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787582896.139128:0:6504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1787582896.146554:0:6504:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787582896.146597:0:6504:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3cd4188b988 00100000:10000000:0.0:1787582896.146605:0:6504:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787582896.149980:0:6504:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787582896.150000:0:6504:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787582896.150021:0:6504:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787582896.150045:0:6504:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787582896.150889:0:6504:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787582896.151079:0:6504:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787582896.464190:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582897.489837:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582898.510567:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582899.538691:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582900.559567:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787582901.204418:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787582901.204428:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787582901.204432:0:38:0:(import.c:65:import_set_state_nolock()) 0000000060108e12 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787582901.204474:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000060108e12 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1787582901.204500:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005ae8da02 x1874416435727616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787582901.204545:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ae8da02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874416435727616:0@lo:38: 00000100:00100000:3.0:1787582901.205695:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787582901.205715:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435727488:0@lo:400: 00000100:00100000:3.0:1787582901.215166:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582901.215263:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435727488 00000100:00100000:3.0:1787582901.215272:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435727488 00000100:00100000:3.0:1787582901.215331:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787582901.215339:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006f3442e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+11:3656:x1874416435727488:12345-0@lo:400: 00000100:00100000:3.0:1787582901.215394:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006f3442e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+11:3656:x1874416435727488:12345-0@lo:400: Request processed in 56us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582901.215401:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787582901.215896:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3126445 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435727488:0@lo:400: 00000100:00100000:0.0:1787582901.220868:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582901.223456:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435727616 00000100:00100000:3.0:1787582901.223478:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435727616 00000100:00100000:3.0:1787582901.223550:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582901.223560:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007148d82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874416435727616:12345-0@lo:38: 00010000:00080000:3.0:1787582901.223607:0:6529:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1787582901.225689:0:6529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x19a47956376b5d5b 00000004:00100000:3.0:1787582901.225754:0:6529:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787582901.225986:0:6529:0:(import.c:65:import_set_state_nolock()) 00000000c7d972e5 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787582901.226123:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007148d82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874416435727616:12345-0@lo:38: Request processed in 2560us (5259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582901.226138:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787582901.237461:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005ae8da02 x1874416435727616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787582911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787582901.237488:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787582901.237496:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787582901.237501:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787582901.237505:0:3652:0:(import.c:65:import_set_state_nolock()) 0000000060108e12 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787582901.237512:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ae8da02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874416435727616:0@lo:38: 00000001:02000400:1.0:1787582901.351839:0:6805:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787582901.584709:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787582902.441187:0:6857:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787582902.441459:0:6857:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787582902.606578:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582903.630049:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787582903.758186:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787582903.758195:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff909348740800 from 3 10000000:01000000:3.0:1787582903.758264:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787582903.758316:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582903.758329:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582903.758340:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582903.758362:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435727744:0@lo:101: 00000100:00100000:3.0:1787582903.758429:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582903.758540:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be7bd2b9 going to sleep for 11 seconds 00000100:00100000:0.0:1787582903.759361:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435727744 00000100:00100000:0.0:1787582903.759371:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435727744 00000100:00100000:0.0:1787582903.759433:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787582903.759442:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c761eec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+11:6525:x1874416435727744:12345-0@lo:101: 00010000:00010000:0.0:1787582903.759473:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582903.759488:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005116cc9e/0x19a47956376b5d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5d62 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582903.759512:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005116cc9e/0x19a47956376b5d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5d62 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582903.759521:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005116cc9e/0x19a47956376b5d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5d62 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582903.759529:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005116cc9e, rc 0) 00000100:00100000:0.0:1787582903.759583:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c761eec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6525:x1874416435727744:12345-0@lo:101: Request processed in 142us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582903.759590:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787582903.762379:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435727744:0@lo:101: 00010000:00010000:1.0:1787582903.762409:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582903.762421:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5d69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582903.762508:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008369e10d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435727872:0@lo:256: 00000100:00100000:1.0:1787582903.762570:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582903.762683:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c25447e7 going to sleep for 11 seconds 00000100:00100000:0.0:1787582903.765725:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435727872 00000100:00100000:0.0:1787582903.765738:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435727872 00000100:00100000:0.0:1787582903.765873:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787582903.765882:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcc95561 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6525:x1874416435727872:12345-0@lo:256: 20000000:01000000:0.0:1787582903.765907:0:6522:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787582903.765940:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787582903.765944:0:6522:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787582903.766070:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcc95561 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+12:6525:x1874416435727872:12345-0@lo:256: Request processed in 190us (3501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582903.766078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787582903.766162:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008369e10d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435727872:0@lo:256: 10000000:01000000:1.0:1787582903.766225:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787582903.766233:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582903.766243:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582904.658136:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787582905.379823:0:6958:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787582905.380046:0:6958:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787582905.678629:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582906.318270:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e0deac1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435728128:0@lo:400: 00000100:00100000:3.0:1787582906.318348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582906.318432:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435728128 00000100:00100000:3.0:1787582906.318440:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435728128 00000100:00100000:3.0:1787582906.318496:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582906.318503:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a714712 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435728128:12345-0@lo:400: 00000100:00100000:3.0:1787582906.318551:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a714712 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435728128:12345-0@lo:400: Request processed in 49us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582906.318557:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787582906.318596:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002e0deac1 x1874416435728128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582906.318609:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e0deac1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435728128:0@lo:400: 00000100:00100000:1.0:1787582906.318788:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582906.318798:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435728000:0@lo:400: 00000100:00100000:1.0:1787582906.318834:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582906.319011:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435728000 00000100:00100000:3.0:1787582906.319025:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435728000 00000100:00100000:3.0:1787582906.319060:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787582906.319066:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009696d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:3655:x1874416435728000:12345-0@lo:400: 00000100:00100000:3.0:1787582906.319149:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009696d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:3655:x1874416435728000:12345-0@lo:400: Request processed in 83us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582906.319156:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787582906.320113:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435728000:0@lo:400: 00010000:00010000:1.0:1787582906.701999:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582907.729461:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582908.750270:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582909.774635:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582910.806090:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582911.438761:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582911.438786:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008369e10d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435728256:0@lo:400: 00000100:00100000:1.0:1787582911.438890:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582911.438949:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003844c152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435728384:0@lo:400: 00000100:00100000:1.0:1787582911.438980:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582911.439018:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435728256 00000100:00100000:1.0:1787582911.439025:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435728256 00000100:00100000:1.0:1787582911.439067:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787582911.439075:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000923f3877 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+12:3653:x1874416435728256:12345-0@lo:400: 00000100:00100000:1.0:1787582911.439120:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000923f3877 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+12:3653:x1874416435728256:12345-0@lo:400: Request processed in 46us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582911.439136:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787582911.439196:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435728384 00000100:00100000:1.0:1787582911.439201:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435728384 00000100:00100000:1.0:1787582911.439230:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582911.439235:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025eb2646 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435728384:12345-0@lo:400: 00000100:00100000:1.0:1787582911.439271:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025eb2646 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435728384:12345-0@lo:400: Request processed in 36us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582911.439277:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787582911.439312:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003844c152 x1874416435728384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582911.439326:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003844c152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435728384:0@lo:400: 00000100:00100000:1.0:1787582911.439352:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008369e10d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435728256:0@lo:400: 00010000:00010000:1.0:1787582911.824281:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582912.847270:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582913.873005:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582914.894899:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582915.917957:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787582915.988101:0:7457:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787582915.988105:0:7457:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787582915.988107:0:7457:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787582915.988269:0:7457:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e1ebb225 00000020:01000004:3.0:1787582915.988285:0:7457:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1787582915.988295:0:7457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787582915.988307:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000008c1e2bd0) 00000020:00000080:3.0:1787582915.988322:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787582916.055020:0:7457:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1787582916.055120:0:7457:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1787582916.078297:0:7457:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787582916.078524:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787582916.078535:0:7457:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787582916.078546:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x19a47956376b5d77 00000020:01000004:1.0:1787582916.078553:0:7457:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787582916.078574:0:7457:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787582916.078578:0:7457:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787582916.078585:0:7457:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787582916.078611:0:7457:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787582916.078616:0:7457:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787582916.108694:0:7457:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787582916.108735:0:7457:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1787582916.108739:0:7457:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787582916.108741:0:7457:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787582916.108742:0:7457:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582916.108743:0:7457:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582916.108744:0:7457:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582916.108745:0:7457:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582916.108746:0:7457:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582916.108748:0:7457:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787582916.108749:0:7457:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787582916.108751:0:7457:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582916.108752:0:7457:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787582916.108756:0:7457:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1787582916.108758:0:7457:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787582916.108759:0:7457:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787582916.108760:0:7457:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582916.108762:0:7457:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582916.108762:0:7457:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582916.108763:0:7457:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582916.108764:0:7457:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582916.108765:0:7457:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787582916.108766:0:7457:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787582916.108767:0:7457:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582916.108768:0:7457:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787582916.108795:0:7457:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787582916.108815:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e0deac1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435728512:0@lo:253: 00000100:00100000:3.0:1787582916.108986:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.109071:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028d9e215 going to sleep for 11 seconds 00000100:00100000:0.0:1787582916.109172:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435728512 00000100:00100000:0.0:1787582916.109183:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435728512 00000100:00100000:0.0:1787582916.109266:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787582916.109285:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000304bf6a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+12:7457:x1874416435728512:12345-0@lo:253: 20000000:01000000:0.0:1787582916.109317:0:6521:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787582916.109322:0:6521:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1787582916.109327:0:6521:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1787582916.109331:0:6521:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1787582916.109363:0:6521:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1787582916.109549:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787582916.109681:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787582916.109694:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787582916.109713:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1787582916.109727:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1787582916.109739:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1787582916.109787:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1787582916.109795:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1787582916.109805:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1787582916.109810:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1787582916.109820:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1787582916.109838:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1787582916.110309:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1787582916.110330:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1787582916.110434:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1787582916.110443:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:0.0:1787582916.110455:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1787582916.110461:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787582916.110471:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1787582916.110476:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:0.0:1787582916.110487:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1787582916.110492:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787582916.110504:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1787582916.110518:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1787582916.110538:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787582916.110610:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1787582916.110619:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1787582916.110630:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1787582916.110647:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1787582916.110663:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1787582916.110668:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1787582916.110680:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1787582916.110699:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1787582916.110704:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1787582916.110725:0:6521:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787582916.110732:0:6521:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1787582916.111541:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787582916.111779:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787582916.111808:0:6521:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.111@tcp for mdt 20000000:01000000:0.0:1787582916.111810:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:0.0:1787582916.111836:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787582916.111842:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787582916.112094:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787582916.112103:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:1.0:1787582916.112209:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787582916.112220:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1787582916.112233:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1787582916.112249:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1787582916.112335:0:6521:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1787582916.112345:0:6521:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1787582916.112630:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1787582916.112788:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787582916.112807:0:6521:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.111@tcp for mdt 20000000:01000000:3.0:1787582916.112816:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:3.0:1787582916.112887:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787582916.112895:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787582916.112909:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787582916.112914:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:3.0:1787582916.112925:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787582916.112931:0:6521:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1787582916.112942:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787582916.112954:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1787582916.112976:0:6521:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787582916.112980:0:6521:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787582916.112984:0:6521:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787582916.113045:0:6521:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787582916.113047:0:6521:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787582916.113396:0:7465:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787582916.113416:0:7465:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787582916.113428:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787582916.113557:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787582916.113576:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787582916.113595:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787582916.113604:0:6521:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787582916.113606:0:6521:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787582916.114073:0:7466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787582916.114094:0:7466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787582916.114107:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1787582916.114326:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787582916.114346:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787582916.114362:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1787582916.114372:0:6521:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787582916.114374:0:6521:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787582916.114617:0:7467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787582916.114634:0:7467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787582916.114648:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787582916.114786:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1787582916.114804:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1787582916.114819:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1787582916.115017:0:6521:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787582916.115021:0:6521:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787582916.115028:0:6521:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787582916.115035:0:6521:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787582916.115442:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1787582916.115554:0:6521:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787582916.125476:0:6521:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787582916.125522:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.125539:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c1279f4a/0x19a47956376b5cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5cac expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.125545:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005abe5bd8/0x19a47956376b5ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5cc8 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.125550:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b51778c2/0x19a47956376b5d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5d38 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.125555:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.125593:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b51778c2/0x19a47956376b5d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5d38 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.125606:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b51778c2/0x19a47956376b5d3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5d38 expref: 12 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582916.125618:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054e974bd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6521:1874416435728640:0@lo:104: 00000100:00100000:3.0:1787582916.125677:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787582916.125761:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005abe5bd8/0x19a47956376b5ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5cc8 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.125770:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005abe5bd8/0x19a47956376b5ccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5cc8 expref: 12 pid: 6520 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582916.125790:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000005a39c2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6521:1874416435728768:0@lo:104: 00000100:00100000:3.0:1787582916.125813:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787582916.125887:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c1279f4a/0x19a47956376b5cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5cac expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.125895:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c1279f4a/0x19a47956376b5cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5cac expref: 12 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582916.125903:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000477feaed pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6521:1874416435728896:0@lo:104: 00000100:00100000:3.0:1787582916.125928:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.125937:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000acb53e1a going to sleep for 11 seconds 00000100:00100000:1.0:1787582916.126004:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435728640 00000100:00100000:1.0:1787582916.126012:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435728640 00000100:00100000:1.0:1787582916.126048:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435728768 00000100:00100000:1.0:1787582916.126051:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435728768 00000100:00100000:1.0:1787582916.126061:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435728896 00000100:00100000:1.0:1787582916.126063:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435728896 00000100:00100000:1.0:1787582916.126075:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582916.126082:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0d6a916 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:6521:x1874416435728640:12345-0@lo:104: 00010000:00010000:1.0:1787582916.126097:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5d3f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.126155:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787582916.126160:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0d6a916 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:6521:x1874416435728640:12345-0@lo:104: Request processed in 79us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582916.126167:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582916.126189:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582916.126194:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004487463 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6521:x1874416435728768:12345-0@lo:104: 00010000:00010000:1.0:1787582916.126201:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5ccf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.126239:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787582916.126243:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004487463 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6521:x1874416435728768:12345-0@lo:104: Request processed in 51us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582916.126257:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582916.126269:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582916.126275:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8462aff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6521:x1874416435728896:12345-0@lo:104: 00010000:00010000:1.0:1787582916.126281:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5cb3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.126292:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787582916.126298:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5d3f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.126305:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000008414f67 already unused, calling callback (00000000059fe3b4) 00010000:00010000:1.0:1787582916.126307:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:2.0:1787582916.126308:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5d3f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582916.126311:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8462aff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6521:x1874416435728896:12345-0@lo:104: Request processed in 38us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582916.126316:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787582916.126317:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5d3f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582916.126323:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5d3f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582916.126329:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582916.126329:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787582916.126355:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5d3f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.126361:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582916.126380:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5d3f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582916.126384:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054e974bd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6521:1874416435728640:0@lo:104: 00010000:00010000:2.0:1787582916.126386:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 0000000008414f67/0x19a47956376b5d38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5d3f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582916.126396:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435729024:0@lo:103: 00010000:00010000:2.0:1787582916.126398:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582916.126400:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5cb3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.126405:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bcb10478 already unused, calling callback (00000000059fe3b4) 10000000:00010000:2.0:1787582916.126407:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5cb3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.126418:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5cb3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582916.126419:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1787582916.126423:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5cb3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582916.126428:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787582916.126444:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5cb3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.126449:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787582916.126449:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435729024 00000100:00100000:1.0:1787582916.126452:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435729024 00010000:00010000:2.0:1787582916.126460:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5cb3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.126466:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 00000000bcb10478/0x19a47956376b5cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5cb3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.126466:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b51778c2/0x19a47956376b5d3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5d38 expref: 13 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.126476:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582916.126478:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582916.126479:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582916.126485:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582916.126490:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008369e10d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:3656:x1874416435729024:12345-0@lo:103: 00010000:00010000:1.0:1787582916.126500:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582916.126503:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b51778c2/0x19a47956376b5d3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5d38 expref: 13 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.126513:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b51778c2/0x19a47956376b5d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5d38 expref: 13 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.126536:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b51778c2/0x19a47956376b5d3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5d38 expref: 13 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.126546:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582916.126579:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008369e10d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:3656:x1874416435729024:12345-0@lo:103: Request processed in 89us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582916.126586:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582916.126602:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c271bffa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435729152:0@lo:103: 00000100:00100000:1.0:1787582916.126623:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582916.126649:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435729152 00000100:00100000:1.0:1787582916.126652:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435729152 00010000:00010000:1.0:1787582916.126662:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c1279f4a/0x19a47956376b5cb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5cac expref: 12 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582916.126678:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582916.126683:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003844c152 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+12:3653:x1874416435729152:12345-0@lo:103: 00010000:00010000:1.0:1787582916.126689:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582916.126693:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c1279f4a/0x19a47956376b5cb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5cac expref: 12 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.126700:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c1279f4a/0x19a47956376b5cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5cac expref: 12 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.126709:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582916.126742:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003844c152 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+12:3653:x1874416435729152:12345-0@lo:103: Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582916.126748:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582916.126778:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000005a39c2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6521:1874416435728768:0@lo:104: 00010000:00010000:1.0:1787582916.126793:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c1279f4a/0x19a47956376b5cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5cac expref: 11 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582916.126803:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000477feaed pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6521:1874416435728896:0@lo:104: 00010000:00010000:1.0:1787582916.126822:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582916.126899:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c271bffa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435729152:0@lo:103: 00000100:00100000:2.0:1787582916.126961:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435729024:0@lo:103: 00010000:00010000:2.0:1787582916.127931:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582916.127935:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582916.127937:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582916.127977:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5ccf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.127987:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009196a7ce already unused, calling callback (00000000059fe3b4) 10000000:00010000:1.0:1787582916.127990:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5ccf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.127998:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5ccf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582916.128005:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5ccf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582916.128010:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582916.128044:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5ccf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128051:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582916.128069:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5ccf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128075:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000009196a7ce/0x19a47956376b5cc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5ccf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128102:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582916.128104:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582916.128105:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582916.128121:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582916.128133:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9ecf497 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435729280:0@lo:103: 00000100:00100000:1.0:1787582916.128175:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582916.128215:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435729280 00000100:00100000:1.0:1787582916.128220:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435729280 00010000:00010000:1.0:1787582916.128239:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005abe5bd8/0x19a47956376b5ccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5cc8 expref: 11 pid: 6520 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582916.128260:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582916.128267:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e365aa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+11:3653:x1874416435729280:12345-0@lo:103: 00010000:00010000:1.0:1787582916.128276:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582916.128280:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005abe5bd8/0x19a47956376b5ccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5cc8 expref: 11 pid: 6520 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128289:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005abe5bd8/0x19a47956376b5ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5cc8 expref: 11 pid: 6520 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128299:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005abe5bd8/0x19a47956376b5ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5cc8 expref: 11 pid: 6520 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128311:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128318:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128341:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128347:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128352:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128358:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128363:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001800c8f8 already unused, calling callback (00000000d14ff72a) 00010000:00010000:1.0:1787582916.128365:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128371:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128393:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.128403:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582916.128431:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e365aa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+10:3653:x1874416435729280:12345-0@lo:103: Request processed in 164us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582916.128437:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582916.128466:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9ecf497 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435729280:0@lo:103: 00010000:00010000:3.0:1787582916.130096:0:6521:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.130111:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.130117:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001800c8f8/0x19a47956376b5d7e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787582916.130136:0:6521:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787582916.132457:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000304bf6a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+9:7457:x1874416435728512:12345-0@lo:253: Request processed in 23168us (23465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.132470:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787582916.132559:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e0deac1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435728512:0@lo:253: 10000000:01000000:2.0:1787582916.132574:0:7457:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787582916.132577:0:7457:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787582916.132579:0:7457:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787582916.132591:0:7457:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582916.132592:0:7457:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1787582916.132594:0:7457:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582916.132595:0:7457:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582916.132596:0:7457:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787582916.132598:0:7457:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787582916.132599:0:7457:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582916.132601:0:7457:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787582916.132631:0:7457:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e1ebb225 from lustre-MDT0001 10000000:01000000:2.0:1787582916.132665:0:7457:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787582916.132669:0:7457:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787582916.132677:0:7457:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff909343e199b8 local copy 10000000:01000000:2.0:1787582916.132681:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787582916.132712:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.132723:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.132731:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582916.132748:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435729408:0@lo:101: 00000100:00100000:2.0:1787582916.132783:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.132835:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a40a14f going to sleep for 11 seconds 00000100:00100000:3.0:1787582916.132907:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435729408 00000100:00100000:3.0:1787582916.132915:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435729408 00000100:00100000:3.0:1787582916.132959:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787582916.132976:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080489324 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+9:7457:x1874416435729408:12345-0@lo:101: 00010000:00010000:3.0:1787582916.132988:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582916.132999:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000094c7483d/0x19a47956376b5d8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5d85 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.133020:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000094c7483d/0x19a47956376b5d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5d85 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.133030:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000094c7483d/0x19a47956376b5d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5d85 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.133039:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000094c7483d, rc 0) 00000100:00100000:3.0:1787582916.133066:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080489324 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+10:7457:x1874416435729408:12345-0@lo:101: Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.133073:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787582916.133245:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435729408:0@lo:101: 00010000:00010000:2.0:1787582916.133256:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x19a47956376b5d8c expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.133265:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19a47956376b5d8c expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582916.133351:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435729536:0@lo:501: 00000100:00100000:2.0:1787582916.133387:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.133403:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a40a14f going to sleep for 11 seconds 00000100:00100000:3.0:1787582916.133448:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435729536 00000100:00100000:3.0:1787582916.133452:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435729536 00000100:00100000:3.0:1787582916.133482:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787582916.133488:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d7a103a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+10:7457:x1874416435729536:12345-0@lo:501: 00000100:00100000:3.0:1787582916.133540:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d7a103a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+10:7457:x1874416435729536:12345-0@lo:501: Request processed in 53us (152us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787582916.133547:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787582916.133839:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435729536:0@lo:501: 10000000:01000000:2.0:1787582916.133904:0:7457:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787582916.133921:0:7457:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787582916.133926:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19a47956376b5d8c expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.133934:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19a47956376b5d8c expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.133941:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19a47956376b5d8c expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.133959:0:7457:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787582916.133981:0:7457:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90936d90b000 10000000:01000000:2.0:1787582916.133986:0:7457:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787582916.133991:0:7457:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff909343e199b8 10000000:01000000:2.0:1787582916.133993:0:7457:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787582916.133996:0:7457:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff909343e199b8 from 1 10000000:01000000:2.0:1787582916.134000:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787582916.134016:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000049f1cc42/0x19a47956376b5d93 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134023:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000049f1cc42/0x19a47956376b5d93 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134031:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000049f1cc42/0x19a47956376b5d93 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582916.134055:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435729664:0@lo:101: 00000100:00100000:2.0:1787582916.134080:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.134103:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435729664 00000100:00100000:2.0:1787582916.134107:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435729664 00000100:00100000:2.0:1787582916.134144:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787582916.134150:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba6990d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+10:7457:x1874416435729664:12345-0@lo:101: 00010000:00010000:2.0:1787582916.134157:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582916.134167:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052f4508a/0x19a47956376b5d9a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5d93 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134181:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052f4508a/0x19a47956376b5d9a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5d93 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134188:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052f4508a/0x19a47956376b5d9a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5d93 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134195:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052f4508a, rc 0) 00000100:00100000:2.0:1787582916.134217:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba6990d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+11:7457:x1874416435729664:12345-0@lo:101: Request processed in 68us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.134222:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787582916.134250:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000661672d3 going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.134261:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435729664:0@lo:101: 00010000:00010000:2.0:1787582916.134270:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000049f1cc42/0x19a47956376b5d93 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d9a expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134277:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000049f1cc42/0x19a47956376b5d93 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5d9a expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582916.134302:0:7457:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787582916.134312:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000049f1cc42/0x19a47956376b5d93 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d9a expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134318:0:7457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000049f1cc42/0x19a47956376b5d93 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5d9a expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582916.134323:0:7457:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90936d90b000 10000000:01000000:2.0:1787582916.134339:0:7457:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787582916.134341:0:7457:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90936d90b000 from 1 10000000:01000000:2.0:1787582916.134343:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787582916.134354:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000c214dad7/0x19a47956376b5da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134359:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000c214dad7/0x19a47956376b5da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134364:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000c214dad7/0x19a47956376b5da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582916.134373:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435729792:0@lo:101: 00000100:00100000:2.0:1787582916.134396:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.134416:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435729792 00000100:00100000:2.0:1787582916.134419:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435729792 00000100:00100000:2.0:1787582916.134439:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787582916.134444:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7fff059 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+11:7457:x1874416435729792:12345-0@lo:101: 00010000:00010000:2.0:1787582916.134450:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582916.134456:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000e171271/0x19a47956376b5da8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5da1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134476:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e171271/0x19a47956376b5da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5da1 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134483:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000e171271/0x19a47956376b5da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5da1 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134488:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000e171271, rc 0) 00000100:00100000:2.0:1787582916.134509:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7fff059 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:7457:x1874416435729792:12345-0@lo:101: Request processed in 66us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.134515:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787582916.134536:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000661672d3 going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.134547:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435729792:0@lo:101: 00010000:00010000:2.0:1787582916.134556:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000c214dad7/0x19a47956376b5da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134562:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000c214dad7/0x19a47956376b5da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582916.134571:0:7457:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787582916.134577:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000c214dad7/0x19a47956376b5da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134583:0:7457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000c214dad7/0x19a47956376b5da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582916.134589:0:7457:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787582916.134600:0:7457:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787582916.134605:0:7457:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90936d90b000 10000000:01000000:2.0:1787582916.134613:0:7457:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787582916.134616:0:7457:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787582916.134623:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787582916.134637:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000003c9ad6d7/0x19a47956376b5daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134644:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000003c9ad6d7/0x19a47956376b5daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134650:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000003c9ad6d7/0x19a47956376b5daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582916.134660:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435729920:0@lo:101: 00000100:00100000:2.0:1787582916.134682:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.134700:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435729920 00000100:00100000:2.0:1787582916.134704:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435729920 00000100:00100000:2.0:1787582916.134724:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787582916.134728:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd4b8795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:7457:x1874416435729920:12345-0@lo:101: 00010000:00010000:2.0:1787582916.134735:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582916.134740:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dd55842b/0x19a47956376b5db6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5daf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134753:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd55842b/0x19a47956376b5db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5daf expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134759:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dd55842b/0x19a47956376b5db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5daf expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134766:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dd55842b, rc 0) 00000100:00100000:2.0:1787582916.134789:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd4b8795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435729920:12345-0@lo:101: Request processed in 60us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.134799:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787582916.134821:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000661672d3 going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.134864:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435729920:0@lo:101: 00010000:00010000:2.0:1787582916.134874:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000003c9ad6d7/0x19a47956376b5daf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5db6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.134881:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000003c9ad6d7/0x19a47956376b5daf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5db6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582916.134947:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435730048:0@lo:501: 00000100:00100000:2.0:1787582916.134974:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.134991:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435730048 00000100:00100000:2.0:1787582916.134994:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435730048 00000100:00100000:2.0:1787582916.135013:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787582916.135017:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062166df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435730048:12345-0@lo:501: 00000100:00100000:2.0:1787582916.135104:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062166df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435730048:12345-0@lo:501: Request processed in 87us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.135110:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787582916.135132:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000661672d3 going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.135142:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435730048:0@lo:501: 00000100:00100000:2.0:1787582916.135179:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435730176:0@lo:503: 00000100:00100000:2.0:1787582916.135213:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.135231:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435730176 00000100:00100000:2.0:1787582916.135234:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435730176 00000100:00100000:2.0:1787582916.135254:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787582916.135259:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087b7fabd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435730176:12345-0@lo:503: 00000100:00100000:2.0:1787582916.135332:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087b7fabd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435730176:12345-0@lo:503: Request processed in 73us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.135338:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787582916.135370:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000661672d3 going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.135380:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435730176:0@lo:503: 00000040:00080000:2.0:1787582916.135664:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787582916.135739:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435730304:0@lo:502: 00000100:00100000:2.0:1787582916.135770:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.135791:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435730304 00000100:00100000:2.0:1787582916.135794:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435730304 00000100:00100000:2.0:1787582916.135815:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787582916.135820:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a683ce16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435730304:12345-0@lo:502: 00000100:00100000:2.0:1787582916.135925:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a683ce16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435730304:12345-0@lo:502: Request processed in 104us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.135931:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787582916.135960:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000661672d3 going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.135972:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435730304:0@lo:502: 00000040:00080000:2.0:1787582916.136178:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787582916.136204:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1787582916.136216:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1787582916.136228:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1787582916.136239:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1787582916.136251:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1787582916.136262:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1787582916.136274:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1787582916.136289:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1787582916.136302:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1787582916.136326:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1787582916.136340:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1787582916.136352:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1787582916.136365:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1787582916.136377:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1787582916.136389:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1787582916.136402:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1787582916.136414:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1787582916.136425:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1787582916.136437:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1787582916.136449:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1787582916.136462:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1787582916.136474:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1787582916.136494:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435730432:0@lo:502: 00000100:00100000:2.0:1787582916.136528:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.136551:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435730432 00000100:00100000:2.0:1787582916.136555:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435730432 00000100:00100000:2.0:1787582916.136578:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787582916.136584:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a17d978 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435730432:12345-0@lo:502: 00000100:00100000:2.0:1787582916.136644:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a17d978 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435730432:12345-0@lo:502: Request processed in 59us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.136651:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787582916.136681:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000661672d3 going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.136694:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f0fdff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435730432:0@lo:502: 00000040:00080000:2.0:1787582916.136728:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1787582916.136735:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00010000:00010000:3.0:1787582916.137449:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582916.137457:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x19a47956376b5d8c expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.137467:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d963ea18 already unused, calling callback (00000000059fe3b4) 10000000:00010000:3.0:1787582916.137471:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x19a47956376b5d8c expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.137492:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x19a47956376b5d8c expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582916.137499:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x19a47956376b5d8c expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582916.137504:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582916.137528:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a47956376b5d8c expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.137534:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582916.137560:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a47956376b5d8c expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.137567:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 00000000d963ea18/0x19a47956376b5d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a47956376b5d8c expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.137579:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582916.137581:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582916.137582:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582916.137681:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c61b75e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435730560:0@lo:103: 00000100:00100000:1.0:1787582916.137723:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.138251:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435730560 00000100:00100000:3.0:1787582916.138259:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435730560 00000100:00100000:3.0:1787582916.138305:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582916.138314:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9ecf497 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:3655:x1874416435730560:12345-0@lo:103: 00010000:00010000:3.0:1787582916.138325:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582916.138339:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000094c7483d/0x19a47956376b5d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b5d85 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.138352:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582916.138393:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9ecf497 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:3655:x1874416435730560:12345-0@lo:103: Request processed in 80us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.138400:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582916.138479:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c61b75e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435730560:0@lo:103: 00000020:01000000:2.0:1787582916.139094:0:7470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582916.139106:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582916.139109:0:7470:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787582916.139122:0:7470:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787582916.139131:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787582916.139154:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000f69df6b9) 00000020:00000080:2.0:1787582916.139173:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1787582916.139179:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787582916.139260:0:7470:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787582916.139267:0:7470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x19a47956376b5dc4 00000020:00000080:2.0:1787582916.139479:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787582916.139483:0:7470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582916.139487:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582916.139489:0:7470:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787582916.139491:0:7470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582916.139494:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582916.139496:0:7470:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787582916.139499:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787582916.139505:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000b111568d) 00000020:00000080:2.0:1787582916.139516:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1787582916.139520:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787582916.139521:0:7470:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787582916.139524:0:7470:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787582916.139529:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787582916.139570:0:7470:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e1ebb225 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787582916.139580:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000f7563d66) 00000020:00000080:2.0:1787582916.139588:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1787582916.139673:0:7470:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787582916.139678:0:7470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b5dd9 00000020:00000080:2.0:1787582916.139795:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787582916.139801:0:7470:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787582916.139805:0:7470:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x19a47956376b5de0 00080000:01000000:2.0:1787582916.139810:0:7470:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787582916.139813:0:7470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x19a47956376b5de7 00080000:10000000:2.0:1787582916.140229:0:7470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787582916.140340:0:7470:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1787582916.304787:0:7470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1787582916.305134:0:7470:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1787582916.310245:0:7470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787582916.312667:0:7470:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787582916.343501:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787582916.343517:0:7470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582916.343523:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582916.343525:0:7470:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787582916.343529:0:7470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582916.343536:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582916.343538:0:7470:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787582916.343541:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787582916.343546:0:7470:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:3.0:1787582916.343573:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787582916.343587:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000d89ca9da) 00000020:00000080:3.0:1787582916.343607:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787582916.343612:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787582916.344794:0:7470:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787582916.344803:0:7470:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787582916.344813:0:7470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x19a47956376b5df5 00010000:00080000:3.0:1787582916.344873:0:7470:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fd0e5bec@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1787582916.354330:0:7470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1787582916.355655:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787582916.355670:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787582916.355708:0:7470:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787582916.355727:0:7470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b5dfc 00000100:00080000:0.0:1787582916.355746:0:7470:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787582916.355751:0:7470:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000fd0e5bec using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1787582916.355786:0:7470:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b45d8301 x1874416435730688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787582916.355815:0:7470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787582916.355897:0:7470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582916.355901:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582916.355903:0:7470:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787582916.355905:0:7470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787582916.355908:0:7470:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787582916.355910:0:7470:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787582916.355912:0:7470:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787582916.355913:0:7470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787582916.355915:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582916.355916:0:7470:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787582916.355918:0:7470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582916.355922:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582916.355924:0:7470:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787582916.355927:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787582916.355955:0:7470:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787582916.355967:0:7470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582916.355970:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582916.355971:0:7470:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787582916.355973:0:7470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582916.355976:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582916.355977:0:7470:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787582916.355979:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787582916.355981:0:7470:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787582916.356012:0:7470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582916.356014:0:7470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582916.356016:0:7470:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787582916.356018:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1787582916.356226:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b45d8301 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435730688:0@lo:38: 00000100:00100000:2.0:1787582916.356296:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.356385:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435730688 00000100:00100000:2.0:1787582916.356392:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435730688 00000100:00100000:2.0:1787582916.356420:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787582916.356425:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024f0fdff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874416435730688:12345-0@lo:38: 00010000:00080000:2.0:1787582916.356447:0:6532:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:2.0:1787582916.356475:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b5e03 00000004:00100000:2.0:1787582916.356488:0:6532:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787582916.356493:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:3.0:1787582916.356871:0:7457:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1787582916.356902:0:7457:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787582916.356914:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000003c9ad6d7/0x19a47956376b5daf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5db6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.356924:0:7457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000003c9ad6d7/0x19a47956376b5daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5db6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582916.356932:0:7457:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90936d90b000 from 1 10000000:01000000:3.0:1787582916.356936:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787582916.356963:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.356970:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.356978:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582916.356994:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e303bf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435730944:0@lo:101: 00000100:00100000:3.0:1787582916.357030:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.357044:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b2eea4c going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.357329:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b07a544 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435730816:0@lo:400: 00000100:00100000:2.0:1787582916.357363:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.357398:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435730944 00000100:00100000:2.0:1787582916.357402:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435730944 00000100:00100000:2.0:1787582916.357434:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787582916.357442:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e799c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+12:7457:x1874416435730944:12345-0@lo:101: 00010000:00010000:2.0:1787582916.357453:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582916.357464:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cc9256f3/0x19a47956376b5e11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5e0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.357483:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc9256f3/0x19a47956376b5e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5e0a expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.357492:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cc9256f3/0x19a47956376b5e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e0a expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.357511:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cc9256f3, rc 0) 00000100:00100000:2.0:1787582916.357547:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e799c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435730944:12345-0@lo:101: Request processed in 106us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.357553:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787582916.360053:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435730816 00000100:00100000:3.0:1787582916.360067:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435730816 00000100:00100000:3.0:1787582916.360149:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582916.360158:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c273b72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435730816:12345-0@lo:400: 00000100:00100000:3.0:1787582916.360248:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c273b72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435730816:12345-0@lo:400: Request processed in 88us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.360254:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582916.360298:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e303bf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435730944:0@lo:101: 00010000:00010000:3.0:1787582916.360329:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e11 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.360340:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5e11 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582916.360930:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e303bf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731072:0@lo:256: 00000100:00100000:3.0:1787582916.360976:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.361009:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b2eea4c going to sleep for 11 seconds 00000100:00100000:3.0:1787582916.361655:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435731072 00000100:00100000:3.0:1787582916.361662:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435731072 00000100:00100000:3.0:1787582916.361701:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787582916.361707:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c85201a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435731072:12345-0@lo:256: 20000000:01000000:3.0:1787582916.361725:0:6521:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787582916.361744:0:6521:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787582916.361747:0:6521:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787582916.361879:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c85201a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435731072:12345-0@lo:256: Request processed in 172us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.361886:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787582916.361930:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e303bf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731072:0@lo:256: 10000000:01000000:3.0:1787582916.362476:0:7457:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787582916.362490:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e11 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.362500:0:7457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e11 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582916.362509:0:7457:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936d90b000 from 1 10000000:01000000:3.0:1787582916.362512:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787582916.362542:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.362548:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.362555:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582916.362571:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e303bf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731200:0@lo:101: 00000100:00100000:3.0:1787582916.362613:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.362628:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b2eea4c going to sleep for 11 seconds 00010000:00080000:2.0:1787582916.364339:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005b07a544 x1874416435730816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582916.364358:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b07a544 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435730816:0@lo:400: 00000100:00100000:2.0:1787582916.364397:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435731200 00000100:00100000:2.0:1787582916.364404:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435731200 00000100:00100000:2.0:1787582916.364456:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787582916.364464:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da6b63d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:7457:x1874416435731200:12345-0@lo:101: 00010000:00010000:2.0:1787582916.364477:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582916.364491:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000abee7ace/0x19a47956376b5e1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5e18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.364515:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000abee7ace/0x19a47956376b5e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5e18 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.364525:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000abee7ace/0x19a47956376b5e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e18 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.364533:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000abee7ace, rc 0) 00000100:00100000:2.0:1787582916.364586:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da6b63d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:7457:x1874416435731200:12345-0@lo:101: Request processed in 123us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.364592:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787582916.367579:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e303bf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731200:0@lo:101: 00010000:00010000:3.0:1787582916.367610:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e1f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.367623:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5e1f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582916.367760:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e303bf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731328:0@lo:501: 00000100:00100000:3.0:1787582916.367817:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.370540:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b2eea4c going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.370629:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435731328 00000100:00100000:2.0:1787582916.370647:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435731328 00000100:00100000:2.0:1787582916.370701:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787582916.370708:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000598b52f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:7457:x1874416435731328:12345-0@lo:501: 00000100:00100000:2.0:1787582916.370886:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000598b52f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:7457:x1874416435731328:12345-0@lo:501: Request processed in 178us (3069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.370894:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787582916.370944:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e303bf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731328:0@lo:501: 00000100:00100000:2.0:1787582916.370995:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9aa04e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731456:0@lo:503: 00000100:00100000:2.0:1787582916.371045:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.371061:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c93fa9a going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.371185:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435731456 00000100:00100000:2.0:1787582916.371189:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435731456 00000100:00100000:2.0:1787582916.371214:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787582916.371219:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fce53e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+14:7457:x1874416435731456:12345-0@lo:503: 00000040:00080000:2.0:1787582916.371253:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787582916.371291:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fce53e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+14:7457:x1874416435731456:12345-0@lo:503: Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.371297:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787582916.371696:0:6532:0:(import.c:65:import_set_state_nolock()) 00000000dbc088b3 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582916.371745:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024f0fdff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1874416435730688:12345-0@lo:38: Request processed in 15318us (15448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582916.371756:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787582916.371909:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787582916.371918:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787582916.371925:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787582916.371931:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787582916.371933:0:3652:0:(import.c:65:import_set_state_nolock()) 00000000fd0e5bec lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787582916.371944:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b45d8301 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435730688:0@lo:38: 00000100:00100000:2.0:1787582916.371973:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9aa04e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731456:0@lo:503: 00000040:00080000:2.0:1787582916.372655:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582916.372728:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1787582916.372817:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787582916.373324:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000040:00080000:1.0:1787582916.377054:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1787582916.377744:0:7457:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787582916.377780:0:7457:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787582916.377797:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e1f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.377811:0:7457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e1f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582916.377914:0:7457:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787582916.377918:0:7457:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90936d90b000 10000000:01000000:2.0:1787582916.377922:0:7457:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90936d90b000 10000000:01000000:2.0:1787582916.377926:0:7457:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787582916.377933:0:7457:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90936d90b000 from 1 10000000:01000000:2.0:1787582916.377936:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787582916.377972:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000000b302898/0x19a47956376b5e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.377981:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000000b302898/0x19a47956376b5e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.377991:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000000b302898/0x19a47956376b5e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582916.378015:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9aa04e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731712:0@lo:101: 00000100:00100000:2.0:1787582916.378093:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.378141:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac1d3c37 going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.378169:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435731712 00000100:00100000:2.0:1787582916.378176:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435731712 00000100:00100000:2.0:1787582916.378216:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787582916.378249:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c838c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+14:7457:x1874416435731712:12345-0@lo:101: 00010000:00010000:2.0:1787582916.378262:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582916.378271:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000998690c/0x19a47956376b5e2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5e26 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.378291:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000998690c/0x19a47956376b5e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5e26 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.378299:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000998690c/0x19a47956376b5e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e26 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.378305:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000998690c, rc 0) 00000100:00100000:2.0:1787582916.378475:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c838c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7457:x1874416435731712:12345-0@lo:101: Request processed in 227us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.378482:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787582916.378531:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9aa04e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731712:0@lo:101: 00010000:00010000:2.0:1787582916.378544:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000000b302898/0x19a47956376b5e26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e2d expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.378552:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000000b302898/0x19a47956376b5e26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5e2d expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582916.378641:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9aa04e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731840:0@lo:501: 00000100:00100000:2.0:1787582916.378666:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.378687:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac1d3c37 going to sleep for 11 seconds 00000100:00100000:3.0:1787582916.379268:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044852f69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435731584:0@lo:41: 00000100:00100000:3.0:1787582916.379308:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.379587:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435731584 00000100:00100000:2.0:1787582916.379593:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435731584 00000100:00100000:2.0:1787582916.379734:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787582916.379743:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034897f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1874416435731584:12345-0@lo:41: 00000004:00000024:2.0:1787582916.379791:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787582916.379874:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034897f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1874416435731584:12345-0@lo:41: Request processed in 133us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.379881:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582916.379958:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435731840 00000100:00100000:1.0:1787582916.379962:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435731840 00000100:00100000:1.0:1787582916.379990:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787582916.379997:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6c23258 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7457:x1874416435731840:12345-0@lo:501: 00000100:00100000:1.0:1787582916.380127:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6c23258 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7457:x1874416435731840:12345-0@lo:501: Request processed in 131us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582916.380134:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787582916.380390:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9aa04e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731840:0@lo:501: 00000100:00100000:2.0:1787582916.380431:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9aa04e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731968:0@lo:503: 00000100:00100000:2.0:1787582916.380474:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.380498:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435731968 00000100:00100000:2.0:1787582916.380502:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435731968 00000100:00100000:2.0:1787582916.380535:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787582916.380541:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c020013c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7457:x1874416435731968:12345-0@lo:503: 00000100:00100000:0.0:1787582916.380911:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044852f69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435731584:0@lo:41: 00000100:00100000:2.0:1787582916.381066:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c020013c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7457:x1874416435731968:12345-0@lo:503: Request processed in 525us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.381072:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787582916.381239:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac1d3c37 going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.381252:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9aa04e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435731968:0@lo:503: 00000040:00080000:0.0:1787582916.382553:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787582916.382666:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000754d6b85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435732096:0@lo:502: 00000100:00100000:0.0:1787582916.382733:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582916.382773:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053f97e39 going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.382841:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435732096 00000100:00100000:2.0:1787582916.382874:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435732096 00000100:00100000:2.0:1787582916.382912:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787582916.382921:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2c31902 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7457:x1874416435732096:12345-0@lo:502: 00000100:00100000:2.0:1787582916.383031:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2c31902 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7457:x1874416435732096:12345-0@lo:502: Request processed in 111us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.383038:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787582916.383174:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000754d6b85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435732096:0@lo:502: 00000040:00080000:0.0:1787582916.383440:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787582916.383471:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787582916.383486:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787582916.383501:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787582916.383515:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787582916.383529:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787582916.383540:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787582916.383550:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787582916.383560:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787582916.383570:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787582916.383580:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787582916.383590:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787582916.383599:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787582916.383609:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787582916.383620:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787582916.383633:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787582916.383645:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787582916.383656:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787582916.383667:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787582916.383682:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787582916.383696:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787582916.383708:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787582916.383719:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787582916.383731:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787582916.383743:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787582916.383767:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787582916.383779:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787582916.383792:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1787582916.383816:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000754d6b85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435732224:0@lo:502: 00000100:00100000:0.0:1787582916.383929:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582916.383956:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053f97e39 going to sleep for 11 seconds 00000100:00100000:3.0:1787582916.384190:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435732224 00000100:00100000:3.0:1787582916.384195:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435732224 00000100:00100000:3.0:1787582916.384238:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787582916.384245:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb58db45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7457:x1874416435732224:12345-0@lo:502: 00000100:00100000:3.0:1787582916.384365:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb58db45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7457:x1874416435732224:12345-0@lo:502: Request processed in 121us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.384372:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787582916.384420:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000754d6b85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435732224:0@lo:502: 00000040:00080000:3.0:1787582916.384487:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787582916.384496:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787582916.384890:0:7476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787582916.384903:0:7476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000ed78df2d) 00000020:00000080:3.0:1787582916.384927:0:7476:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787582916.385013:0:7476:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e1ebb225 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787582916.385016:0:7476:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e1ebb225 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787582916.385018:0:7476:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e1ebb225 3 00010000:00080000:3.0:1787582916.385044:0:7476:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007a563a32@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1787582916.386678:0:7476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1787582916.386927:0:7476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787582916.386974:0:7476:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787582916.386986:0:7476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x19a47956376b5e3b 00000100:00080000:3.0:1787582916.386996:0:7476:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787582916.387001:0:7476:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000007a563a32 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787582916.387050:0:7476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000031a4d217 x1874416435732352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787582916.387148:0:7476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787582916.387730:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031a4d217 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874416435732352:0@lo:38: 00000100:00100000:2.0:1787582916.387812:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.395749:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435732352 00000100:00100000:3.0:1787582916.395768:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435732352 00000100:00100000:3.0:1787582916.395834:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582916.395842:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9aa04e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874416435732352:12345-0@lo:38: 00010000:00080000:3.0:1787582916.395906:0:6528:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:3.0:1787582916.395971:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x19a47956376b5e42 00000004:00100000:3.0:1787582916.395986:0:6528:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787582916.396018:0:6528:0:(import.c:65:import_set_state_nolock()) 00000000858fbb52 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1787582916.397859:0:7476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1787582916.399034:0:7477:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:3.0:1787582916.399454:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9aa04e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874416435732352:12345-0@lo:38: Request processed in 3607us (11640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.399467:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:3.0:1787582916.399502:0:7457:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787582916.399532:0:7457:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787582916.399547:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000000b302898/0x19a47956376b5e26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e2d expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.399566:0:7457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000000b302898/0x19a47956376b5e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e2d expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787582916.399687:0:7457:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787582916.399689:0:7457:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787582916.399691:0:7457:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582916.399692:0:7457:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582916.399693:0:7457:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582916.399695:0:7457:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582916.399696:0:7457:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582916.399698:0:7457:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787582916.399699:0:7457:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787582916.399701:0:7457:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582916.399702:0:7457:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787582916.399706:0:7457:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1787582916.399709:0:7457:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787582916.399711:0:7457:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787582916.399712:0:7457:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582916.399713:0:7457:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582916.399714:0:7457:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582916.399715:0:7457:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582916.399716:0:7457:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582916.399717:0:7457:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787582916.399718:0:7457:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787582916.399719:0:7457:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582916.399720:0:7457:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787582916.399745:0:7457:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787582916.399761:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee844a83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435732480:0@lo:253: 00000100:00100000:3.0:1787582916.399815:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.399880:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c4ddf21 going to sleep for 11 seconds 00010000:00080000:3.0:1787582916.399924:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000031a4d217 x1874416435732352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787582926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582916.399935:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787582916.399943:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787582916.399956:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787582916.399960:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787582916.399962:0:3652:0:(import.c:65:import_set_state_nolock()) 000000007a563a32 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787582916.399968:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031a4d217 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874416435732352:0@lo:38: 00000100:00100000:3.0:1787582916.400000:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435732480 00000100:00100000:3.0:1787582916.400005:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435732480 00000100:00100000:3.0:1787582916.400040:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787582916.400047:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f29ee21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7457:x1874416435732480:12345-0@lo:253: 20000000:01000000:3.0:1787582916.400070:0:6520:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787582916.402224:0:6520:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1787582916.407662:0:6506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787582916.407834:0:6520:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787582916.407867:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787582916.408188:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f29ee21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7457:x1874416435732480:12345-0@lo:253: Request processed in 8137us (8369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.408201:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 20000000:01000000:1.0:1787582916.408434:0:6543:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787582916.408439:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787582916.408455:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.408468:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005116cc9e/0x19a47956376b5d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5d62 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.408474:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cc9256f3/0x19a47956376b5e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e0a expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.408480:0:6543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.408510:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cc9256f3/0x19a47956376b5e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5e0a expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.408540:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cc9256f3/0x19a47956376b5e11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5e0a expref: 14 pid: 6520 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582916.408554:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a5773248 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435732608:0@lo:104: 00000100:00100000:1.0:1787582916.408591:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787582916.408787:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005116cc9e/0x19a47956376b5d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5d62 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.408795:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005116cc9e/0x19a47956376b5d69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5d62 expref: 14 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582916.408803:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d2e98a1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435732736:0@lo:104: 00000100:00100000:1.0:1787582916.408863:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582916.408888:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f42357cf going to sleep for 11 seconds 00000100:00100000:3.0:1787582916.408945:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435732608 00000100:00100000:3.0:1787582916.408952:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435732608 00000100:00100000:3.0:1787582916.408979:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435732736 00000100:00100000:3.0:1787582916.408982:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435732736 00000100:00100000:3.0:1787582916.408994:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787582916.409000:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac593910 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6543:x1874416435732608:12345-0@lo:104: 00010000:00010000:3.0:1787582916.409011:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e11 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409063:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787582916.409068:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac593910 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6543:x1874416435732608:12345-0@lo:104: Request processed in 68us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.409084:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787582916.409104:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582916.409117:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dda9acaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6543:x1874416435732736:12345-0@lo:104: 00010000:00010000:3.0:1787582916.409125:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5d69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409157:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787582916.409161:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dda9acaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6543:x1874416435732736:12345-0@lo:104: Request processed in 53us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.409167:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787582916.409180:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787582916.409185:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e11 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409192:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000094c7483d already unused, calling callback (00000000059fe3b4) 10000000:00010000:3.0:1787582916.409196:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5e11 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409204:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5e11 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582916.409210:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5e11 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582916.409215:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582916.409238:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e11 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409245:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582916.409261:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e11 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409278:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e11 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409289:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582916.409291:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5d69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409297:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008db4efb6 already unused, calling callback (00000000059fe3b4) 10000000:00010000:3.0:1787582916.409299:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5d69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409304:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5d69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582916.409309:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5d69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582916.409702:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582916.409719:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5d69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409725:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582916.409742:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5d69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409748:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5d69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409761:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582916.409768:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582916.409769:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582916.409790:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435732992:0@lo:103: 00000100:00100000:3.0:1787582916.409834:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.409892:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435732992 00000100:00100000:3.0:1787582916.409897:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435732992 00010000:00010000:3.0:1787582916.409912:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005116cc9e/0x19a47956376b5d69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5d62 expref: 15 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582916.409934:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787582916.409940:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e303bf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:3655:x1874416435732992:12345-0@lo:103: 00010000:00010000:3.0:1787582916.409950:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582916.409955:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005116cc9e/0x19a47956376b5d69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5d62 expref: 15 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409963:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005116cc9e/0x19a47956376b5d69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5d62 expref: 15 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.409978:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582916.410003:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e303bf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:3655:x1874416435732992:12345-0@lo:103: Request processed in 63us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.410009:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787582916.410042:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435732992:0@lo:103: 00000100:00100000:3.0:1787582916.410061:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031a4d217 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435732864:0@lo:103: 00000100:00100000:3.0:1787582916.410087:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.410252:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee844a83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:7457:1874416435732480:0@lo:253: 10000000:01000000:2.0:1787582916.410264:0:7457:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787582916.410267:0:7457:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787582916.410269:0:7457:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787582916.410270:0:7457:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582916.410272:0:7457:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582916.410273:0:7457:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582916.410274:0:7457:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582916.410275:0:7457:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787582916.410277:0:7457:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787582916.410278:0:7457:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787582916.410279:0:7457:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582916.410280:0:7457:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787582916.410290:0:7457:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787582916.413488:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582916.414115:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435732864 00000100:00100000:3.0:1787582916.414127:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435732864 00010000:00010000:3.0:1787582916.414160:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cc9256f3/0x19a47956376b5e11 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e0a expref: 15 pid: 6520 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582916.414211:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582916.414219:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038f7702b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:3654:x1874416435732864:12345-0@lo:103: 00010000:00010000:3.0:1787582916.414232:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582916.414237:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cc9256f3/0x19a47956376b5e11 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e0a expref: 15 pid: 6520 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.414248:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cc9256f3/0x19a47956376b5e11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5e0a expref: 15 pid: 6520 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.414269:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.414277:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787582916.414292:0:6513:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005853674s 00010000:00010000:3.0:1787582916.414296:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.414303:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.414402:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.414412:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.414418:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c9fe0e90 already unused, calling callback (00000000d14ff72a) 00010000:00010000:3.0:1787582916.414422:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.414434:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.414444:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.414454:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582916.414518:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038f7702b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:3654:x1874416435732864:12345-0@lo:103: Request processed in 301us (4431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.414526:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582916.414596:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031a4d217 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435732864:0@lo:103: 00010000:00010000:1.0:1787582916.414907:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cc9256f3/0x19a47956376b5e11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5e0a expref: 14 pid: 6520 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582916.414920:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a5773248 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435732608:0@lo:104: 00010000:00010000:1.0:1787582916.414930:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005116cc9e/0x19a47956376b5d69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5d62 expref: 13 pid: 6521 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582916.414938:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d2e98a1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435732736:0@lo:104: 00010000:00010000:1.0:1787582916.414953:0:6543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.414961:0:6543:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.414978:0:6543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.414983:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c9fe0e90/0x19a47956376b5e49 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1787582916.416567:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1787582916.416747:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787582916.417040:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787582916.417531:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787582916.417842:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787582916.418252:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1787582916.420694:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787582916.420998:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1787582916.421512:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1787582916.421797:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1787582916.422056:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1787582916.422452:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1787582916.425882:0:7457:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1787582916.426347:0:7482:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1787582916.426401:0:7482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031a4d217 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7482:1874416435733120:0@lo:700: 00000100:00100000:3.0:1787582916.426460:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.426514:0:7482:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002654155 going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.426567:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435733120 00000100:00100000:2.0:1787582916.426574:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435733120 00000100:00100000:2.0:1787582916.426631:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787582916.426640:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e303bf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7482:x1874416435733120:12345-0@lo:700: 00000040:01000000:0.0:1787582916.427235:0:7457:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787582916.428406:0:7483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7483:1874416435733248:0@lo:1000: 00000100:00100000:3.0:1787582916.428474:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.428506:0:7483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000475a1c0d going to sleep for 11 seconds 00000100:00100000:2.0:1787582916.428555:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435733248 00000100:00100000:2.0:1787582916.428561:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435733248 00000100:00100000:2.0:1787582916.428604:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787582916.428620:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b07a544 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7483:x1874416435733248:12345-0@lo:1000: 00000100:00100000:2.0:1787582916.428804:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b07a544 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7483:x1874416435733248:12345-0@lo:1000: Request processed in 185us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.428811:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582916.428917:0:7483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7483:1874416435733248:0@lo:1000: 00000040:01000000:3.0:1787582916.428947:0:7483:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1787582916.428974:0:7483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7483:1874416435733376:0@lo:700: 00000100:00100000:3.0:1787582916.428998:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.429024:0:7483:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028c2bc5f going to sleep for 11 seconds 00000040:01000000:0.0:1787582916.429300:0:7457:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1787582916.429405:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435733376 00000100:00100000:2.0:1787582916.429410:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435733376 00000100:00100000:2.0:1787582916.429445:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787582916.429452:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c61b75e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7483:x1874416435733376:12345-0@lo:700: 00000100:00100000:2.0:1787582916.429506:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c61b75e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7483:x1874416435733376:12345-0@lo:700: Request processed in 55us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.429513:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582916.429737:0:7483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7483:1874416435733376:0@lo:700: 00000100:00100000:3.0:1787582916.429781:0:7483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7483:1874416435733504:0@lo:900: 00000100:00100000:3.0:1787582916.429808:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.429865:0:7483:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028c2bc5f going to sleep for 11 seconds 00000040:00080000:0.0:1787582916.430058:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787582916.430210:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435733504 00000100:00100000:2.0:1787582916.430216:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435733504 00000100:00100000:2.0:1787582916.430248:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787582916.430254:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e0deac1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7483:x1874416435733504:12345-0@lo:900: 00000100:00100000:2.0:1787582916.430293:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e0deac1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7483:x1874416435733504:12345-0@lo:900: Request processed in 40us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.430299:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00080000:1.0:1787582916.430449:0:7481:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787582916.430453:0:7481:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00010000:00080000:3.0:1787582916.430564:0:7483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bf495f2d x1874416435733504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787582932 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582916.430576:0:7483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7483:1874416435733504:0@lo:900: 00000100:00100000:3.0:1787582916.431557:0:7483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7483:1874416435733632:0@lo:1000: 00000100:00100000:3.0:1787582916.431601:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.431634:0:7483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1b552b0 going to sleep for 11 seconds 00000004:00000080:0.0:1787582916.432039:0:7457:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787582916.432051:0:7457:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:1.0:1787582916.432587:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435733632 00000100:00100000:1.0:1787582916.432594:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435733632 00000040:00080000:0.0:1787582916.432903:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787582916.433992:0:7457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787582916.434494:0:7457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787582916.434521:0:7457:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787582916.434717:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:2.0:1787582916.436019:0:6534:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00080000:10000000:0.0:1787582916.439193:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787582916.439995:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787582916.440142:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787582916.440272:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787582916.440426:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787582916.440574:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787582916.440794:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787582916.441035:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787582916.441163:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787582916.441318:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787582916.441459:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787582916.441578:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787582916.441764:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000100:00100000:2.0:1787582916.447930:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582916.447950:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000477feaed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7483:x1874416435733632:12345-0@lo:1000: 00000100:00100000:2.0:1787582916.448793:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000477feaed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7483:x1874416435733632:12345-0@lo:1000: Request processed in 849us (17188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.448803:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582916.448894:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e303bf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7482:x1874416435733120:12345-0@lo:700: Request processed in 22254us (22434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582916.448902:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:0.0:1787582916.451194:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787582916.451402:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787582916.451525:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787582916.452183:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787582916.452520:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00010000:00080000:2.0:1787582916.452838:0:7482:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000031a4d217 x1874416435733120/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787582932 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582916.452882:0:7482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031a4d217 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7482:1874416435733120:0@lo:700: 40000000:02000000:2.0:1787582916.452897:0:7482:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1787582916.456263:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787582916.456435:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787582916.456569:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787582916.457605:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787582916.458471:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787582916.458603:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000100:00100000:3.0:1787582916.459891:0:7483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7483:1874416435733632:0@lo:1000: 00000004:00080000:3.0:1787582916.459969:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000028c2bc5f with version 0 00000020:00100000:3.0:1787582916.459995:0:7483:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787582916.460000:0:7483:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000bf495f2d x1874416435733888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787582916.460018:0:7483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7483:1874416435733888:0@lo:1000: 00000100:00100000:3.0:1787582916.460085:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582916.460779:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435733888 00000100:00100000:3.0:1787582916.460787:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435733888 00000100:00100000:3.0:1787582916.460872:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787582916.460881:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000005a39c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7483:x1874416435733888:12345-0@lo:1000: 00000100:00100000:3.0:1787582916.461175:0:7483:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034eb922f going to sleep for 11 seconds 00100000:10000000:0.0:1787582916.462099:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787582916.462419:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787582916.462604:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787582916.464313:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787582916.464502:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787582916.464638:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787582916.464774:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00000001:00080000:3.0:1787582916.466605:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1787582916.466733:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000005a39c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7483:x1874416435733888:12345-0@lo:1000: Request processed in 5849us (6644us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787582916.466745:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1787582916.466796:0:7483:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787582916.466800:0:7483:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787582916.466814:0:7483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7483:1874416435733888:0@lo:1000: 00000100:00100000:3.0:1787582916.467052:0:7483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7483:1874416435734016:0@lo:1000: 00000100:00100000:3.0:1787582916.467091:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:1.0:1787582916.471769:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00000100:00100000:2.0:1787582916.472951:0:7483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000475a1c0d going to sleep for 11 seconds 00100000:10000000:1.0:1787582916.478161:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787582916.478404:0:7457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787582916.479282:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435734016 00000100:00100000:3.0:1787582916.479293:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435734016 00000100:00100000:3.0:1787582916.479355:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582916.479365:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054e974bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7483:x1874416435734016:12345-0@lo:1000: 00000100:00100000:3.0:1787582916.479496:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054e974bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7483:x1874416435734016:12345-0@lo:1000: Request processed in 134us (12405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582916.479504:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787582916.479611:0:7483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf495f2d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7483:1874416435734016:0@lo:1000: 00000040:00080000:2.0:1787582916.479666:0:7483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787582916.479710:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000000e96d7c0 with version 1 00000040:00080000:2.0:1787582916.481841:0:7483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787582916.481953:0:7483:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787582916.483838:0:7473:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000e3954685 version 1 rpc_version 1 00000020:00100000:1.0:1787582916.483903:0:7473:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787582916.483913:0:7473:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001d2e98a1 x1874416435734272/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787582916.483936:0:7473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d2e98a1 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7473:1874416435734272:0@lo:1000: 00000100:00100000:1.0:1787582916.484008:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582916.484052:0:7473:0:(client.c:2715:ptlrpc_set_wait()) set 000000005104f5d3 going to sleep for 11 seconds 00000100:00100000:0.0:1787582916.484172:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435734272 00000100:00100000:0.0:1787582916.484180:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435734272 00000100:00100000:0.0:1787582916.484220:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787582916.484227:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5773248 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7473:x1874416435734272:12345-0@lo:1000: 00000001:00080000:1.0:1787582916.486293:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1787582916.486446:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5773248 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7473:x1874416435734272:12345-0@lo:1000: Request processed in 2216us (2436us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787582916.486457:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1787582916.486539:0:7473:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787582916.486543:0:7473:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787582916.486559:0:7473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d2e98a1 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7473:1874416435734272:0@lo:1000: 00000001:00080000:1.0:1787582916.503294:0:7457:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787582916.503334:0:7457:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa3cd41cc7988 00100000:10000000:1.0:1787582916.503346:0:7457:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:2.0:1787582916.503451:0:7482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582916.506455:0:7482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787582916.506517:0:7482:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787582916.506520:0:7482:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:3.0:1787582916.511706:0:7457:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787582916.511741:0:7457:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787582916.511964:0:7457:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787582916.511989:0:7457:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787582916.512743:0:7457:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787582916.512995:0:7457:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787582916.943895:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582917.968460:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582918.990159:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582920.014522:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582921.040988:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787582921.313378:0:7728:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787582921.679597:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000dd4381b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435734784:0@lo:400: 00000100:00100000:1.0:1787582921.679669:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582921.679722:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787582921.679729:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d2e98a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435734400:0@lo:41: 00000100:00100000:1.0:1787582921.679751:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582921.679768:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097e54df2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435734912:0@lo:400: 00000100:00100000:1.0:1787582921.679808:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582921.679841:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8719f21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435734656:0@lo:400: 00000100:00100000:1.0:1787582921.679879:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582921.679896:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582921.679901:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e629834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435734528:0@lo:400: 00000100:00100000:1.0:1787582921.679926:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582921.679956:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435734784 00000100:00100000:1.0:1787582921.679963:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435734784 00000100:00100000:1.0:1787582921.679997:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435734400 00000100:00100000:1.0:1787582921.680000:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435734400 00000100:00100000:1.0:1787582921.680014:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787582921.680021:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077c66059 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3655:x1874416435734784:12345-0@lo:400: 00000100:00100000:1.0:1787582921.680074:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077c66059 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3655:x1874416435734784:12345-0@lo:400: Request processed in 53us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582921.680081:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787582921.680096:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787582921.680102:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008369e10d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435734400:12345-0@lo:41: 00000004:00000024:1.0:1787582921.681481:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1787582921.681549:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008369e10d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435734400:12345-0@lo:41: Request processed in 1445us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582921.681559:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787582921.681610:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435734912 00000100:00100000:1.0:1787582921.681617:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435734912 00000100:00100000:0.0:1787582921.681643:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435734656 00000100:00100000:0.0:1787582921.681655:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435734656 00000100:00100000:1.0:1787582921.681657:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582921.681667:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003844c152 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435734912:12345-0@lo:400: 00000100:00100000:0.0:1787582921.681684:0:6527:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787582921.681693:0:6527:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787582921.681705:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003844c152 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435734912:12345-0@lo:400: Request processed in 40us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582921.681713:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582921.681725:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787582921.681731:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e365aa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435734656:12345-0@lo:400: 00000100:00100000:1.0:1787582921.681763:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e365aa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435734656:12345-0@lo:400: Request processed in 33us (1883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582921.681770:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787582921.681826:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f8719f21 x1874416435734656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582921.681842:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8719f21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435734656:0@lo:400: 00000100:00100000:1.0:1787582921.681894:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d2e98a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435734400:0@lo:41: 00010000:00080000:1.0:1787582921.681904:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000097e54df2 x1874416435734912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582921.681913:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097e54df2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435734912:0@lo:400: 00000100:00100000:1.0:1787582921.681923:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000dd4381b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435734784:0@lo:400: 00000100:00100000:0.0:1787582921.684948:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435734528 00000100:00100000:0.0:1787582921.685080:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435734528 00000100:00100000:0.0:1787582921.685142:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787582921.685151:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000583359b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+13:3654:x1874416435734528:12345-0@lo:400: 00000100:00100000:0.0:1787582921.685246:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000583359b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+13:3654:x1874416435734528:12345-0@lo:400: Request processed in 97us (5319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582921.685329:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787582921.685486:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e629834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435734528:0@lo:400: 00010000:00010000:2.0:1787582922.062360:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787582922.466393:0:7781:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787582922.466637:0:7781:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787582923.086182:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787582923.726030:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787582923.726038:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90936d90b000 from 4 10000000:01000000:3.0:1787582923.726043:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787582923.726093:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.726105:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.726124:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582923.726372:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435735040:0@lo:101: 00000100:00100000:3.0:1787582923.728737:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582923.728971:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435735040 00000100:00100000:0.0:1787582923.728981:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435735040 00000100:00100000:0.0:1787582923.729050:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787582923.729059:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a22a84f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:6525:x1874416435735040:12345-0@lo:101: 00010000:00010000:0.0:1787582923.729078:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582923.729097:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005116cc9e/0x19a47956376b5e57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5e50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.729124:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005116cc9e/0x19a47956376b5e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5e50 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.729133:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005116cc9e/0x19a47956376b5e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e50 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.729142:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005116cc9e, rc 0) 00000100:00100000:0.0:1787582923.729183:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a22a84f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:6525:x1874416435735040:12345-0@lo:101: Request processed in 125us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582923.729189:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787582923.729272:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c420f0d7 going to sleep for 11 seconds 00000100:00100000:3.0:1787582923.729295:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435735040:0@lo:101: 00010000:00010000:3.0:1787582923.729323:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5e50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.729331:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5e50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5e57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582923.729400:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435735168:0@lo:256: 00000100:00100000:3.0:1787582923.729445:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582923.729502:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435735168 00000100:00100000:0.0:1787582923.729506:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435735168 00000100:00100000:0.0:1787582923.729550:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787582923.729556:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b2da9db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+14:6525:x1874416435735168:12345-0@lo:256: 20000000:01000000:0.0:1787582923.729570:0:6521:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787582923.729586:0:6521:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787582923.729589:0:6521:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787582923.729657:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b2da9db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+14:6525:x1874416435735168:12345-0@lo:256: Request processed in 101us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582923.729664:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787582923.737764:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c420f0d7 going to sleep for 11 seconds 00000100:00100000:3.0:1787582923.737822:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435735168:0@lo:256: 10000000:01000000:3.0:1787582923.738442:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787582923.738462:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5e50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.738472:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000008db4efb6/0x19a47956376b5e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582923.738483:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787582923.738485:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff909348740800 from 21 10000000:01000000:3.0:1787582923.738488:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787582923.740128:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.740153:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.740164:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582923.740190:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435735296:0@lo:101: 00000100:00100000:3.0:1787582923.740259:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582923.740311:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c420f0d7 going to sleep for 11 seconds 00000100:00100000:0.0:1787582923.740643:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435735296 00000100:00100000:0.0:1787582923.740658:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435735296 00000100:00100000:0.0:1787582923.740712:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787582923.740721:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c037c36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+14:6525:x1874416435735296:12345-0@lo:101: 00010000:00010000:0.0:1787582923.740734:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582923.740746:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005abe5bd8/0x19a47956376b5e65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5e5e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.740768:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005abe5bd8/0x19a47956376b5e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5e5e expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.740789:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005abe5bd8/0x19a47956376b5e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e5e expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.740797:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005abe5bd8, rc 0) 00000100:00100000:0.0:1787582923.740842:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c037c36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435735296:12345-0@lo:101: Request processed in 123us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582923.740882:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787582923.741254:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435735296:0@lo:101: 00010000:00010000:3.0:1787582923.741271:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.741279:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5e65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582923.742679:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435735424:0@lo:501: 00000100:00100000:3.0:1787582923.742751:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582923.742808:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c420f0d7 going to sleep for 11 seconds 00000100:00100000:2.0:1787582923.743136:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435735424 00000100:00100000:2.0:1787582923.743153:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435735424 00000100:00100000:2.0:1787582923.743197:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787582923.743205:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e9d4ef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435735424:12345-0@lo:501: 00000100:00100000:2.0:1787582923.744615:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e9d4ef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435735424:12345-0@lo:501: Request processed in 1406us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582923.744628:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787582923.744766:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435735424:0@lo:501: 00000100:00100000:3.0:1787582923.744824:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435735552:0@lo:503: 00000100:00100000:3.0:1787582923.744900:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582923.744981:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c420f0d7 going to sleep for 11 seconds 00000100:00100000:1.0:1787582923.745263:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435735552 00000100:00100000:1.0:1787582923.745277:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435735552 00000100:00100000:1.0:1787582923.745417:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787582923.745425:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8e52e7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435735552:12345-0@lo:503: 00000100:00100000:1.0:1787582923.745536:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8e52e7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435735552:12345-0@lo:503: Request processed in 112us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582923.745542:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787582923.745614:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435735552:0@lo:503: 00000100:00100000:3.0:1787582923.746126:0:7833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:7833:1874416435735680:0@lo:502: 00000100:00100000:3.0:1787582923.746174:0:7833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582923.746207:0:7833:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e17b9c5 going to sleep for 11 seconds 00000100:00100000:2.0:1787582923.746421:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435735680 00000100:00100000:2.0:1787582923.746427:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435735680 00000100:00100000:2.0:1787582923.746462:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787582923.746469:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fee0f745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7833:x1874416435735680:12345-0@lo:502: 00000100:00100000:2.0:1787582923.746574:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fee0f745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7833:x1874416435735680:12345-0@lo:502: Request processed in 105us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582923.746581:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787582923.746834:0:7833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:7833:1874416435735680:0@lo:502: 00000100:00100000:3.0:1787582923.746910:0:7833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:7833:1874416435735808:0@lo:502: 00000100:00100000:3.0:1787582923.746944:0:7833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582923.746971:0:7833:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079c8732a going to sleep for 11 seconds 00000100:00100000:2.0:1787582923.747800:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435735808 00000100:00100000:2.0:1787582923.747808:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435735808 00000100:00100000:2.0:1787582923.747869:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787582923.747877:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bbddf30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7833:x1874416435735808:12345-0@lo:502: 00000100:00100000:2.0:1787582923.747989:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bbddf30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:7833:x1874416435735808:12345-0@lo:502: Request processed in 113us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582923.747996:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787582923.748510:0:7833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:7833:1874416435735808:0@lo:502: 00000040:00080000:3.0:1787582923.748543:0:7833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787582923.748759:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787582923.748793:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787582923.748802:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.748821:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000094c7483d/0x19a47956376b5e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582923.748830:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787582923.748832:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff909348740800 from 4 10000000:01000000:0.0:1787582923.748835:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787582923.748887:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000c1279f4a/0x19a47956376b5e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.748895:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000c1279f4a/0x19a47956376b5e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.748903:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000c1279f4a/0x19a47956376b5e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582923.748920:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e2488be pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435735936:0@lo:101: 00000100:00100000:0.0:1787582923.748956:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582923.748989:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f59bd46c going to sleep for 11 seconds 00000100:00100000:1.0:1787582923.750045:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435735936 00000100:00100000:1.0:1787582923.750112:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435735936 00000100:00100000:1.0:1787582923.750221:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787582923.750230:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b944761d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435735936:12345-0@lo:101: 00010000:00010000:1.0:1787582923.750244:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582923.750259:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ae9f8770/0x19a47956376b5e73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5e6c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582923.750284:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae9f8770/0x19a47956376b5e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5e6c expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582923.750294:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ae9f8770/0x19a47956376b5e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e6c expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582923.750303:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ae9f8770, rc 0) 00000100:00100000:1.0:1787582923.750355:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b944761d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435735936:12345-0@lo:101: Request processed in 125us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582923.750361:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787582923.750425:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e2488be pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435735936:0@lo:101: 00010000:00010000:0.0:1787582923.750439:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000c1279f4a/0x19a47956376b5e6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.750448:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000c1279f4a/0x19a47956376b5e6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5e73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582923.750510:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e2488be pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435736064:0@lo:256: 00000100:00100000:0.0:1787582923.750834:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582923.750890:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f59bd46c going to sleep for 11 seconds 00000100:00100000:1.0:1787582923.751134:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435736064 00000100:00100000:1.0:1787582923.751140:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435736064 00000100:00100000:1.0:1787582923.751167:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787582923.751172:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001215cc5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435736064:12345-0@lo:256: 20000000:01000000:1.0:1787582923.751187:0:6522:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787582923.751209:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787582923.751212:0:6522:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787582923.751396:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001215cc5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435736064:12345-0@lo:256: Request processed in 222us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582923.751404:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787582923.751468:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e2488be pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435736064:0@lo:256: 10000000:01000000:0.0:1787582923.751816:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787582923.751825:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000c1279f4a/0x19a47956376b5e6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.751834:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000c1279f4a/0x19a47956376b5e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582923.751901:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787582923.751904:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787582923.751907:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787582923.752006:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.752014:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.752022:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582923.752037:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e2488be pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435736192:0@lo:101: 00000100:00100000:0.0:1787582923.752132:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582923.752204:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f59bd46c going to sleep for 11 seconds 00000100:00100000:1.0:1787582923.752247:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435736192 00000100:00100000:1.0:1787582923.752253:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435736192 00000100:00100000:1.0:1787582923.752278:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787582923.752284:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004507e8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435736192:12345-0@lo:101: 00010000:00010000:1.0:1787582923.752295:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582923.752303:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009d9ba565/0x19a47956376b5e81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5e7a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582923.752321:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009d9ba565/0x19a47956376b5e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5e7a expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582923.752330:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009d9ba565/0x19a47956376b5e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e7a expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582923.752337:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009d9ba565, rc 0) 00000100:00100000:1.0:1787582923.752414:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004507e8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435736192:12345-0@lo:101: Request processed in 130us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582923.752420:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787582923.752481:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e2488be pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435736192:0@lo:101: 00010000:00010000:0.0:1787582923.752492:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5e7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.752500:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5e7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5e81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582923.755028:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e2488be pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435736320:0@lo:501: 00000100:00100000:0.0:1787582923.755105:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582923.755155:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f59bd46c going to sleep for 11 seconds 00000100:00100000:1.0:1787582923.755245:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435736320 00000100:00100000:1.0:1787582923.755251:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435736320 00000100:00100000:1.0:1787582923.755306:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787582923.755317:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000733f157e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435736320:12345-0@lo:501: 00000100:00100000:1.0:1787582923.755481:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000733f157e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435736320:12345-0@lo:501: Request processed in 165us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582923.755507:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787582923.755735:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e2488be pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435736320:0@lo:501: 00000100:00100000:0.0:1787582923.755766:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e2488be pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435736448:0@lo:503: 00000100:00100000:0.0:1787582923.755816:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582923.755837:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f59bd46c going to sleep for 11 seconds 00000100:00100000:2.0:1787582923.755908:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435736448 00000100:00100000:2.0:1787582923.755913:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435736448 00000100:00100000:2.0:1787582923.755954:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787582923.755961:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000484024c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435736448:12345-0@lo:503: 00000100:00100000:2.0:1787582923.756105:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000484024c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435736448:12345-0@lo:503: Request processed in 144us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582923.756122:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787582923.756487:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e2488be pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435736448:0@lo:503: 00000100:00100000:1.0:1787582923.757262:0:7834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e629834 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:7834:1874416435736576:0@lo:502: 00000100:00100000:1.0:1787582923.757319:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582923.759267:0:7834:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f4fd5ae going to sleep for 11 seconds 00000100:00100000:2.0:1787582923.759413:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435736576 00000100:00100000:2.0:1787582923.759424:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435736576 00000100:00100000:2.0:1787582923.759507:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787582923.759525:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000786394c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:7834:x1874416435736576:12345-0@lo:502: 00000100:00100000:2.0:1787582923.759693:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000786394c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:7834:x1874416435736576:12345-0@lo:502: Request processed in 178us (2374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582923.759700:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787582923.759874:0:7834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e629834 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:7834:1874416435736576:0@lo:502: 00000020:01000000:1.0:1787582923.759906:0:7834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582923.759918:0:7834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582923.759931:0:7834:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787582923.759937:0:7834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787582923.759940:0:7834:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:1.0:1787582923.759964:0:7834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787582923.759979:0:7834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000006dbfd44c) 00000020:00000080:1.0:1787582923.759998:0:7834:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1787582923.760003:0:7834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787582923.760404:0:7834:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787582923.760411:0:7834:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787582923.760418:0:7834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b5e8f 00010000:00080000:1.0:1787582923.760455:0:7834:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000deb17f94@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1787582923.762564:0:7834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1787582923.763730:0:7834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787582923.763745:0:7834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787582923.763790:0:7834:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787582923.763816:0:7834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b5e96 00000100:00080000:3.0:1787582923.763826:0:7834:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787582923.763831:0:7834:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000deb17f94 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787582923.766377:0:7834:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000968d2004 x1874416435736704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787582923.766596:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435736704:0@lo:38: 00000100:00100000:2.0:1787582923.766682:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787582923.766742:0:7834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1787582923.766822:0:7834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1787582923.767800:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043faaf74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435736960:0@lo:400: 00000100:00100000:0.0:1787582923.767863:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582923.767891:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787582923.767896:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6f46344 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435736832:0@lo:400: 00000100:00100000:0.0:1787582923.767922:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582923.767950:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000696c0a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435737088:0@lo:400: 00000100:00100000:0.0:1787582923.767976:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582923.768016:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435736704 00000020:01000000:3.0:1787582923.768820:0:7834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582923.768829:0:7834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582923.768831:0:7834:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787582923.768834:0:7834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582923.768839:0:7834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582923.768840:0:7834:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787582923.768843:0:7834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787582923.768883:0:7834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787582923.768915:0:7834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:7834:1874416435737216:0@lo:502: 00000100:00100000:3.0:1787582923.768973:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582923.769000:0:7834:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e17b9c5 going to sleep for 11 seconds 00000100:00080000:3.0:1787582923.769090:0:7837:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000005d56721c x1874416435737344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582923.769099:0:7837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d501efe8 going to sleep for 0 seconds 00000100:00100000:0.0:1787582923.769284:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435736704 00000100:00100000:0.0:1787582923.769322:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435736960 00000100:00100000:0.0:1787582923.769325:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435736960 00000100:00100000:0.0:1787582923.769347:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787582923.769353:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f428a118 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874416435736704:12345-0@lo:38: 00010000:00080000:0.0:1787582923.769378:0:6532:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000100:00100000:1.0:1787582923.769561:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435736832 00000100:00100000:1.0:1787582923.769565:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435736832 00000100:00100000:1.0:1787582923.769593:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435737088 00000100:00100000:1.0:1787582923.769596:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435737088 00000100:00100000:1.0:1787582923.769613:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787582923.769619:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7084a4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435736832:12345-0@lo:400: 00000100:00100000:1.0:1787582923.769687:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7084a4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435736832:12345-0@lo:400: Request processed in 68us (1764us total) trans 0 rc 0/0 00000020:00000080:0.0:1787582923.769692:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b5e9d 00000100:00100000:1.0:1787582923.769701:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00100000:0.0:1787582923.769707:0:6532:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787582923.769712:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787582923.769716:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582923.769721:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c298a49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435737088:12345-0@lo:400: 00000100:00100000:1.0:1787582923.769754:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c298a49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435737088:12345-0@lo:400: Request processed in 34us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582923.769759:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787582923.769818:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f6f46344 x1874416435736832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787582923.769818:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000696c0a50 x1874416435737088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582923.769830:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6f46344 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435736832:0@lo:400: 00000100:00100000:0.0:1787582923.769831:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000696c0a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435737088:0@lo:400: 00000100:00100000:2.0:1787582923.770041:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435737216 00000100:00100000:2.0:1787582923.770046:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435737216 00000100:00100000:2.0:1787582923.770084:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787582923.770091:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f41700 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:7834:x1874416435737216:12345-0@lo:502: 00000100:00100000:2.0:1787582923.770211:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f41700 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:7834:x1874416435737216:12345-0@lo:502: Request processed in 120us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582923.770217:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787582923.770413:0:7834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:7834:1874416435737216:0@lo:502: 00000020:01000000:1.0:1787582923.770444:0:7834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582923.770450:0:7834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582923.770452:0:7834:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787582923.770456:0:7834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787582923.770799:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787582923.770823:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787582923.770831:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5e7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582923.770841:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000006bb188a/0x19a47956376b5e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5e81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582923.770877:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787582923.770880:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff909343e199b8 from 1 10000000:01000000:2.0:1787582923.770882:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787582923.770908:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000bfd6e3f2/0x19a47956376b5ea4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582923.770915:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000bfd6e3f2/0x19a47956376b5ea4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582923.770922:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000bfd6e3f2/0x19a47956376b5ea4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582923.770938:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000030c372d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435737472:0@lo:101: 00000100:00100000:2.0:1787582923.770971:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582923.771000:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000764a3729 going to sleep for 11 seconds 00000100:00100000:1.0:1787582923.771115:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435737472 00000100:00100000:1.0:1787582923.771121:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435737472 00000100:00100000:1.0:1787582923.771153:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787582923.771160:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e62115c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435737472:12345-0@lo:101: 00010000:00010000:1.0:1787582923.771169:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582923.771179:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000034c3f82f/0x19a47956376b5eab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582923.771198:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034c3f82f/0x19a47956376b5eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5ea4 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582923.771206:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000034c3f82f/0x19a47956376b5eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5ea4 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582923.771228:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000034c3f82f, rc 0) 00000100:00100000:1.0:1787582923.771268:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e62115c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435737472:12345-0@lo:101: Request processed in 108us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582923.771273:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787582923.774690:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000030c372d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435737472:0@lo:101: 00010000:00010000:0.0:1787582923.774720:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000bfd6e3f2/0x19a47956376b5ea4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5eab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582923.774732:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000bfd6e3f2/0x19a47956376b5ea4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5eab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582923.774877:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000696c0a50 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435737600:0@lo:501: 00000100:00100000:0.0:1787582923.774934:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582923.774977:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac58f6be going to sleep for 11 seconds 00000100:00100000:3.0:1787582923.775184:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435737600 00000100:00100000:3.0:1787582923.775191:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435737600 00000100:00100000:3.0:1787582923.775236:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787582923.775244:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e2fa1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435737600:12345-0@lo:501: 00000100:00100000:3.0:1787582923.775462:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e2fa1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435737600:12345-0@lo:501: Request processed in 218us (527us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787582923.775469:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787582923.775564:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000696c0a50 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435737600:0@lo:501: 10000000:01000000:2.0:1787582923.775594:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787582923.775600:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000bfd6e3f2/0x19a47956376b5ea4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5eab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582923.775623:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000bfd6e3f2/0x19a47956376b5ea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5eab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787582923.791564:0:6532:0:(import.c:65:import_set_state_nolock()) 000000008733357d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787582923.791665:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f428a118 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874416435736704:12345-0@lo:38: Request processed in 22310us (24982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582923.791675:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787582923.791708:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787582923.791718:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d094435c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435736960:12345-0@lo:400: 00000100:00100000:0.0:1787582923.791764:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d094435c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435736960:12345-0@lo:400: Request processed in 48us (23900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582923.791781:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787582923.792330:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043faaf74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435736960:0@lo:400: 00000100:00100000:2.0:1787582923.793946:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787582923.793960:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787582923.793968:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787582923.793973:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787582923.793976:0:3652:0:(import.c:65:import_set_state_nolock()) 00000000deb17f94 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787582923.794004:0:3652:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d501efe8): req@000000005d56721c x1874416435737344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582923.794034:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000968d2004 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435736704:0@lo:38: 00000100:00100000:3.0:1787582923.794374:0:7837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582923.794422:0:7837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d501efe8 going to sleep for 11 seconds 00000100:00100000:2.0:1787582923.794532:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582923.794544:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014fe088f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435737728:0@lo:41: 00000100:00100000:2.0:1787582923.794572:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582923.794891:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435737344 00000100:00100000:0.0:1787582923.794899:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435737344 00000100:00100000:0.0:1787582923.795100:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435737728 00000100:00100000:0.0:1787582923.795105:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435737728 00000100:00100000:0.0:1787582923.795123:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787582923.795149:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000968d2004 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7837:x1874416435737344:12345-0@lo:1000: 00000100:00100000:0.0:1787582923.795282:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000968d2004 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7837:x1874416435737344:12345-0@lo:1000: Request processed in 135us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582923.795290:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787582923.795317:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787582923.795324:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000928783e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435737728:12345-0@lo:41: 00000004:00000024:0.0:1787582923.795348:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787582923.795400:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000928783e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435737728:12345-0@lo:41: Request processed in 77us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582923.795407:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787582923.795531:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014fe088f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435737728:0@lo:41: 00000100:00100000:2.0:1787582923.799403:0:7837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d56721c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7837:1874416435737344:0@lo:1000: 00000040:01000000:2.0:1787582923.799571:0:7837:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787582923.799632:0:7837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073753653 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7837:1874416435737856:0@lo:1000: 00000100:00100000:2.0:1787582923.799701:0:7837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582923.799801:0:7837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce22314c going to sleep for 11 seconds 00000100:00100000:0.0:1787582923.805040:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435737856 00000100:00100000:0.0:1787582923.805057:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435737856 00000100:00100000:0.0:1787582923.805127:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787582923.805136:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c799ebb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7837:x1874416435737856:12345-0@lo:1000: 00000100:00100000:0.0:1787582923.805323:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c799ebb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7837:x1874416435737856:12345-0@lo:1000: Request processed in 188us (5622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582923.805331:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787582923.805912:0:7837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073753653 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7837:1874416435737856:0@lo:1000: 00000100:00100000:2.0:1787582923.806001:0:7837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073753653 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7837:1874416435737984:0@lo:700: 00000100:00100000:2.0:1787582923.806051:0:7837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582923.806083:0:7837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d303e1ed going to sleep for 11 seconds 00000100:00100000:0.0:1787582923.806242:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435737984 00000100:00100000:0.0:1787582923.806247:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435737984 00000100:00100000:0.0:1787582923.806285:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582923.806292:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0b05596 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7837:x1874416435737984:12345-0@lo:700: 00000100:00100000:0.0:1787582923.806361:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0b05596 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7837:x1874416435737984:12345-0@lo:700: Request processed in 70us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582923.806369:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582923.806432:0:7837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073753653 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7837:1874416435737984:0@lo:700: 00000100:00100000:1.0:1787582923.806626:0:7837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e629834 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7837:1874416435738112:0@lo:1000: 00000100:00100000:1.0:1787582923.806655:0:7837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582923.806678:0:7837:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a4f5c52 going to sleep for 11 seconds 00000100:00100000:0.0:1787582923.807185:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435738112 00000100:00100000:0.0:1787582923.807191:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435738112 00000100:00100000:0.0:1787582923.807223:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787582923.807239:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dd4381b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7837:x1874416435738112:12345-0@lo:1000: 00000100:00100000:0.0:1787582923.807313:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dd4381b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7837:x1874416435738112:12345-0@lo:1000: Request processed in 75us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582923.807319:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787582923.807456:0:7837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e629834 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7837:1874416435738112:0@lo:1000: 00000004:00080000:1.0:1787582923.807513:0:7837:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000003e5a36df with version 0 00000020:00100000:1.0:1787582923.807528:0:7837:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787582923.807534:0:7837:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004e629834 x1874416435738368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787582923.807548:0:7837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e629834 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7837:1874416435738368:0@lo:1000: 00000100:00100000:1.0:1787582923.807573:0:7837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582923.807586:0:7837:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066fed150 going to sleep for 11 seconds 00000100:00100000:0.0:1787582923.808277:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435738368 00000100:00100000:0.0:1787582923.808284:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435738368 00000100:00100000:0.0:1787582923.808328:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787582923.808334:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097e54df2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7837:x1874416435738368:12345-0@lo:1000: 00000001:00080000:1.0:1787582923.812381:0:7459:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1787582923.812396:0:7459:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787582923.812990:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097e54df2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7837:x1874416435738368:12345-0@lo:1000: Request processed in 4652us (5412us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787582923.813004:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1787582923.813165:0:7837:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787582923.813172:0:7837:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787582923.813188:0:7837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e629834 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7837:1874416435738368:0@lo:1000: 00000100:00100000:1.0:1787582923.813304:0:7837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e629834 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7837:1874416435738496:0@lo:1000: 00000100:00100000:1.0:1787582923.813343:0:7837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582923.813375:0:7837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c098b167 going to sleep for 11 seconds 00000100:00100000:3.0:1787582923.813551:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435738496 00000100:00100000:3.0:1787582923.813560:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435738496 00000100:00100000:3.0:1787582923.813608:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787582923.813616:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d2e98a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7837:x1874416435738496:12345-0@lo:1000: 00000100:00100000:3.0:1787582923.813700:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d2e98a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7837:x1874416435738496:12345-0@lo:1000: Request processed in 86us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582923.813714:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787582923.814039:0:7837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e629834 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7837:1874416435738496:0@lo:1000: 00000040:00080000:1.0:1787582923.814057:0:7837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787582923.814159:0:7837:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000003e5a36df with version 1 00000004:00080000:3.0:1787582923.814829:0:7835:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000033daec5d version 1 rpc_version 1 00000020:00100000:3.0:1787582923.814888:0:7835:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787582923.814895:0:7835:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000201cb4d4 x1874416435738752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787582923.814911:0:7835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7835:1874416435738752:0@lo:1000: 00000100:00100000:3.0:1787582923.814954:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582923.814986:0:7835:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022f8e029 going to sleep for 11 seconds 00000100:00100000:2.0:1787582923.816886:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435738752 00000100:00100000:2.0:1787582923.816921:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435738752 00000100:00100000:2.0:1787582923.816977:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787582923.816986:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf495f2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7835:x1874416435738752:12345-0@lo:1000: 00000040:00080000:1.0:1787582923.818685:0:7837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787582923.819482:0:7837:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787582923.819491:0:7837:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1787582923.819821:0:7459:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1787582923.820013:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf495f2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7835:x1874416435738752:12345-0@lo:1000: Request processed in 3025us (5055us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787582923.820025:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1787582923.820124:0:7835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787582923.820133:0:7835:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787582923.820149:0:7835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7835:1874416435738752:0@lo:1000: 00010000:00010000:3.0:1787582924.110147:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582925.138114:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787582925.302806:0:7887:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787582925.303595:0:7887:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787582926.161265:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787582926.300765:0:7935:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceb194aa0 20000000:00000080:2.0:1787582926.300784:0:7935:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90936ef6f800 uarg=0000000000000000 20000000:01000000:2.0:1787582926.300826:0:7935:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787582926.300835:0:7935:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787582926.300841:0:7935:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787582926.301178:0:7935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787582926.301190:0:7935:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787582926.311999:0:7935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582926.312300:0:7935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787582926.312335:0:7935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787582926.312349:0:7935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787582926.312366:0:7935:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787582926.312382:0:7935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582926.312399:0:7935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5d2a expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582926.312405:0:7935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000abee7ace/0x19a47956376b5e1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e18 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582926.312412:0:7935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582926.312568:0:7935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000abee7ace/0x19a47956376b5e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5e18 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582926.312580:0:7935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000abee7ace/0x19a47956376b5e1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5e18 expref: 17 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582926.312593:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011515842 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7935:1874416435738880:0@lo:104: 00000100:00100000:2.0:1787582926.312660:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582926.312729:0:7935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5d2a expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582926.312737:0:7935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5d31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5d2a expref: 17 pid: 6522 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582926.312746:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd9a51fe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7935:1874416435739008:0@lo:104: 00000100:00100000:2.0:1787582926.312777:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017acd4a3 going to sleep for 11 seconds 00000100:00100000:1.0:1787582926.313000:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787582926.313017:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582926.313053:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435738880 00000100:00100000:1.0:1787582926.313060:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435738880 00000100:00100000:1.0:1787582926.313091:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435739008 00000100:00100000:1.0:1787582926.313094:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435739008 00000100:00100000:1.0:1787582926.313106:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582926.313113:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb4b86ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+4:7935:x1874416435738880:12345-0@lo:104: 00010000:00010000:1.0:1787582926.313124:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e1f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582926.313179:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787582926.313184:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb4b86ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+4:7935:x1874416435738880:12345-0@lo:104: Request processed in 72us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582926.313191:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582926.313227:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787582926.313233:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e629834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+3:7935:x1874416435739008:12345-0@lo:104: 00010000:00010000:1.0:1787582926.313240:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5d31 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582926.313283:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787582926.313288:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e629834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+3:7935:x1874416435739008:12345-0@lo:104: Request processed in 56us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582926.313295:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1787582926.313311:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787582926.313315:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e1f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582926.313323:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001800c8f8 already unused, calling callback (00000000059fe3b4) 10000000:00010000:1.0:1787582926.313326:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5e1f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582926.313333:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5e1f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582926.313340:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5e1f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582926.313345:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787582926.313371:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e1f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582926.313377:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582926.313393:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e1f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582926.313399:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000001800c8f8/0x19a47956376b5e18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e1f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582926.313422:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582926.313425:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5d31 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582926.313430:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000008315d50 already unused, calling callback (00000000059fe3b4) 10000000:00010000:1.0:1787582926.313432:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5d31 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582926.313438:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5d31 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582926.313456:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5d31 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582926.313461:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787582926.313474:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5d31 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582926.313480:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582926.313485:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5d31 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582926.313490:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 0000000008315d50/0x19a47956376b5d2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5d31 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582926.313502:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582926.313504:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582926.313505:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582926.313523:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000132f662 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435739136:0@lo:103: 00000100:00100000:1.0:1787582926.313558:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582926.313583:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582926.313588:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac593910 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435739264:0@lo:103: 00000100:00100000:1.0:1787582926.313608:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787582926.313799:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582926.313810:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435739136 00000100:00100000:3.0:1787582926.313814:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435739136 00010000:00010000:3.0:1787582926.313834:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000abee7ace/0x19a47956376b5e1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e18 expref: 18 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582926.313899:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435739264 00000100:00100000:3.0:1787582926.313903:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435739264 00010000:00010000:3.0:1787582926.313914:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5d31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5d2a expref: 19 pid: 6522 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582926.313927:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787582926.313932:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dda9acaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3653:x1874416435739136:12345-0@lo:103: 00010000:00010000:3.0:1787582926.313942:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582926.313946:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000abee7ace/0x19a47956376b5e1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e18 expref: 19 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.313961:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000abee7ace/0x19a47956376b5e1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5e18 expref: 19 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.313977:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582926.314008:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dda9acaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3653:x1874416435739136:12345-0@lo:103: Request processed in 77us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582926.314015:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787582926.314029:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787582926.314035:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8719f21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+18:3653:x1874416435739264:12345-0@lo:103: 00010000:00010000:3.0:1787582926.314054:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582926.314058:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5d31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5d2a expref: 18 pid: 6522 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.314066:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5d31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5d2a expref: 18 pid: 6522 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.314077:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.314084:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.314097:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.314104:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.314110:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.314121:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.314126:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000011173c2b already unused, calling callback (00000000d14ff72a) 00010000:00010000:3.0:1787582926.314130:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.314136:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.314144:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582926.314154:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582926.314178:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8719f21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+18:3653:x1874416435739264:12345-0@lo:103: Request processed in 143us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582926.314184:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787582926.314220:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac593910 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435739264:0@lo:103: 00000100:00100000:3.0:1787582926.314230:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000132f662 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435739136:0@lo:103: 00010000:00010000:2.0:1787582926.314898:0:7935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000abee7ace/0x19a47956376b5e1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5e18 expref: 17 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582926.314911:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011515842 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7935:1874416435738880:0@lo:104: 00010000:00010000:2.0:1787582926.314922:0:7935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000015d7ddf4/0x19a47956376b5d31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5d2a expref: 16 pid: 6522 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582926.314929:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd9a51fe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7935:1874416435739008:0@lo:104: 00010000:00010000:2.0:1787582926.314946:0:7935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582926.314954:0:7935:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582926.314968:0:7935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582926.314974:0:7935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000011173c2b/0x19a47956376b5eb2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582926.798207:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9ecf497 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435739392:0@lo:41: 00000100:00100000:2.0:1787582926.798287:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582926.798531:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435739392 00000100:00100000:3.0:1787582926.798540:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435739392 00000100:00100000:3.0:1787582926.798597:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787582926.798605:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd9a51fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435739392:12345-0@lo:41: 00000004:00000024:3.0:1787582926.798636:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787582926.798681:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd9a51fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435739392:12345-0@lo:41: Request processed in 78us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582926.798688:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787582926.803265:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9ecf497 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435739392:0@lo:41: 00010000:00010000:3.0:1787582927.186638:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582928.206100:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582928.845998:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9883718 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435739520:0@lo:400: 00000100:00100000:0.0:1787582928.846073:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582928.846121:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000696c0a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435740032:0@lo:400: 00000100:00100000:0.0:1787582928.846153:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582928.846184:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787582928.846190:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043faaf74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435739904:0@lo:400: 00000100:00100000:0.0:1787582928.846216:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582928.846246:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068a731c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435739648:0@lo:400: 00000100:00100000:0.0:1787582928.846270:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582928.846291:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582928.846297:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014fe088f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435739776:0@lo:400: 00000100:00100000:0.0:1787582928.846334:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582928.846362:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435740032 00000100:00100000:0.0:1787582928.846376:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435740032 00000100:00100000:0.0:1787582928.846413:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435739776 00000100:00100000:0.0:1787582928.846416:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435739776 00000100:00100000:0.0:1787582928.846431:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787582928.846439:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6f46344 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435740032:12345-0@lo:400: 00000100:00100000:0.0:1787582928.846498:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6f46344 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435740032:12345-0@lo:400: Request processed in 58us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582928.846505:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787582928.846523:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787582928.846529:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b45d8301 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435739776:12345-0@lo:400: 00000100:00100000:0.0:1787582928.846561:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b45d8301 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435739776:12345-0@lo:400: Request processed in 33us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582928.846568:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787582928.846601:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014fe088f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435739776:0@lo:400: 00000100:00100000:0.0:1787582928.846627:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000696c0a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435740032:0@lo:400: 00000100:00100000:2.0:1787582928.846792:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435739520 00000100:00100000:2.0:1787582928.846797:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435739520 00000100:00100000:2.0:1787582928.846837:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787582928.846863:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a773a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:3656:x1874416435739520:12345-0@lo:400: 00000100:00100000:2.0:1787582928.846906:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a773a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:3656:x1874416435739520:12345-0@lo:400: Request processed in 63us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582928.846913:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787582928.846918:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435739904 00000100:00100000:1.0:1787582928.846925:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435739904 00000100:00100000:1.0:1787582928.846959:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435739648 00000100:00100000:1.0:1787582928.846962:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435739648 00000100:00100000:1.0:1787582928.847038:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787582928.847047:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e2488be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435739904:12345-0@lo:400: 00000100:00100000:1.0:1787582928.847086:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e2488be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435739904:12345-0@lo:400: Request processed in 40us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582928.847092:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787582928.847104:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787582928.847109:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000754d6b85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435739648:12345-0@lo:400: 00000100:00100000:1.0:1787582928.847141:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000754d6b85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435739648:12345-0@lo:400: Request processed in 32us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582928.847147:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787582928.847274:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000043faaf74 x1874416435739904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582928.847286:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043faaf74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435739904:0@lo:400: 00000100:00100000:0.0:1787582928.847295:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9883718 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435739520:0@lo:400: 00000100:00100000:1.0:1787582928.849241:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582928.849268:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000696c0a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435740160:0@lo:41: 00000100:00100000:1.0:1787582928.849509:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787582928.849581:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000068a731c6 x1874416435739648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582928.849595:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068a731c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435739648:0@lo:400: 00000100:00100000:3.0:1787582928.849663:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435740160 00000100:00100000:3.0:1787582928.849671:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435740160 00000100:00100000:3.0:1787582928.850006:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787582928.850015:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9ecf497 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435740160:12345-0@lo:41: 00000004:00000024:3.0:1787582928.850049:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787582928.850094:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9ecf497 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435740160:12345-0@lo:41: Request processed in 80us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582928.850100:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787582928.850178:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000696c0a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435740160:0@lo:41: 00010000:00010000:3.0:1787582929.236293:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787582930.254925:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787582930.254934:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936d90b000 from 1 10000000:01000000:2.0:1787582930.254939:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787582930.254985:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000011173c2b/0x19a47956376b5eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582930.254996:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000011173c2b/0x19a47956376b5eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582930.255006:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000011173c2b/0x19a47956376b5eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582930.255030:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011515842 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435740288:0@lo:101: 00000100:00100000:2.0:1787582930.255137:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582930.255195:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057fa5245 going to sleep for 11 seconds 00000100:00100000:1.0:1787582930.258267:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435740288 00000100:00100000:1.0:1787582930.258281:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435740288 00000100:00100000:1.0:1787582930.258334:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787582930.258343:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c9b8d5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435740288:12345-0@lo:101: 00010000:00010000:1.0:1787582930.258360:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582930.258377:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000bb28bee/0x19a47956376b5ec0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5eb9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582930.258401:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000bb28bee/0x19a47956376b5ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5eb9 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582930.258411:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000bb28bee/0x19a47956376b5ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5eb9 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582930.258435:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000bb28bee, rc 0) 00000100:00100000:1.0:1787582930.258509:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c9b8d5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435740288:12345-0@lo:101: Request processed in 168us (3373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582930.258516:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787582930.258573:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011515842 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435740288:0@lo:101: 00010000:00010000:1.0:1787582930.258590:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000011173c2b/0x19a47956376b5eb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5ec0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582930.258599:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000011173c2b/0x19a47956376b5eb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5ec0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582930.258687:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044852f69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435740416:0@lo:501: 00000100:00100000:1.0:1787582930.258743:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582930.258774:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028c2bc5f going to sleep for 11 seconds 00000100:00100000:1.0:1787582930.258788:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435740416 00000100:00100000:1.0:1787582930.258791:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435740416 00000100:00100000:1.0:1787582930.258817:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787582930.258824:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027299b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435740416:12345-0@lo:501: 00000100:00100000:1.0:1787582930.258964:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027299b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435740416:12345-0@lo:501: Request processed in 141us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582930.258971:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787582930.259000:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044852f69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435740416:0@lo:501: 00000100:00100000:1.0:1787582930.259025:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044852f69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435740544:0@lo:503: 00000100:00100000:1.0:1787582930.259063:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582930.259253:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435740544 00000100:00100000:3.0:1787582930.259258:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435740544 00000100:00100000:3.0:1787582930.259288:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787582930.259294:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d32949f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435740544:12345-0@lo:503: 00000100:00100000:3.0:1787582930.259370:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d32949f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435740544:12345-0@lo:503: Request processed in 76us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582930.259377:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787582930.259433:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028c2bc5f going to sleep for 11 seconds 00000100:00100000:1.0:1787582930.259446:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044852f69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435740544:0@lo:503: 00000100:00100000:3.0:1787582930.259978:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8112:1874416435740672:0@lo:502: 00000100:00100000:3.0:1787582930.260015:0:8112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582930.260042:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f59bd46c going to sleep for 11 seconds 00000100:00100000:1.0:1787582930.261197:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435740672 00000100:00100000:1.0:1787582930.261206:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435740672 00000100:00100000:1.0:1787582930.261252:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787582930.261259:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ac26bd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:8112:x1874416435740672:12345-0@lo:502: 00000100:00100000:1.0:1787582930.261384:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ac26bd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:8112:x1874416435740672:12345-0@lo:502: Request processed in 125us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582930.261391:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787582930.261552:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201cb4d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8112:1874416435740672:0@lo:502: 00000020:01000000:3.0:1787582930.261581:0:8112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582930.261592:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582930.261594:0:8112:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787582930.261601:0:8112:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90936d90b000 00000020:00000080:3.0:1787582930.261603:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787582930.261646:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8112:1874416435740800:0@lo:502: 00000100:00100000:3.0:1787582930.261696:0:8112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582930.261745:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582930.265979:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435740800 00000100:00100000:1.0:1787582930.265994:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435740800 00000100:00100000:1.0:1787582930.266544:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787582930.266557:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:8112:x1874416435740800:12345-0@lo:502: 00000100:00100000:1.0:1787582930.266754:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:8112:x1874416435740800:12345-0@lo:502: Request processed in 200us (5056us total) trans 0 rc 0/0 00010000:00010000:0.0:1787582930.267462:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582930.270791:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8112:1874416435740800:0@lo:502: 00000020:01000000:0.0:1787582930.270875:0:8112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582930.270890:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582930.270892:0:8112:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787582930.270898:0:8112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:1.0:1787582930.281180:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000020:01000000:1.0:1787582930.281274:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787582930.281315:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787582930.281328:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b5eb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5ec0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582930.281340:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b5eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5ec0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582930.281351:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787582930.281354:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff909348740800 from 1 10000000:01000000:1.0:1787582930.281357:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787582930.281396:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582930.281403:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582930.281426:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582930.281451:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435740928:0@lo:101: 00000100:00100000:1.0:1787582930.281506:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582930.281592:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936ed1e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787582930.290474:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435740928 00000100:00100000:3.0:1787582930.290489:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435740928 00000100:00100000:3.0:1787582930.290604:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787582930.290615:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435740928:12345-0@lo:101: 00010000:00010000:3.0:1787582930.290632:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582930.290666:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909341480a00/0x19a47956376b5ece lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5ec7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582930.290693:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909341480a00/0x19a47956376b5ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5ec7 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582930.290705:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909341480a00/0x19a47956376b5ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5ec7 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582930.290714:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480a00, rc 0) 00000100:00100000:3.0:1787582930.294122:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435740928:12345-0@lo:101: Request processed in 3497us (12603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582930.294136:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787582930.298924:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435740928:0@lo:101: 00010000:00010000:0.0:1787582930.298973:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5ece expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582930.298985:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5ece expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582930.299356:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435741056:0@lo:501: 00000100:00100000:0.0:1787582930.299418:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582930.299509:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1300c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582930.299686:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435741056 00000100:00100000:3.0:1787582930.299693:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435741056 00000100:00100000:3.0:1787582930.299753:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787582930.299763:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435741056:12345-0@lo:501: 00000100:00100000:3.0:1787582930.299925:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435741056:12345-0@lo:501: Request processed in 163us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582930.299933:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787582930.299973:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435741056:0@lo:501: 00000100:00100000:3.0:1787582930.300005:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435741184:0@lo:503: 00000100:00100000:3.0:1787582930.300076:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582930.300091:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787582930.300257:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435741184 00000100:00100000:3.0:1787582930.300262:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435741184 00000100:00100000:3.0:1787582930.300279:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787582930.300285:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435741184:12345-0@lo:503: 00000100:00100000:3.0:1787582930.300360:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435741184:12345-0@lo:503: Request processed in 74us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582930.300366:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787582930.300400:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435741184:0@lo:503: 00000100:00100000:3.0:1787582930.300600:0:8114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8114:1874416435741312:0@lo:502: 00000100:00100000:3.0:1787582930.300630:0:8114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582930.300648:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435741312 00000100:00100000:3.0:1787582930.300651:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435741312 00000100:00100000:3.0:1787582930.300668:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787582930.300673:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:8114:x1874416435741312:12345-0@lo:502: 00000100:00100000:3.0:1787582930.300763:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:8114:x1874416435741312:12345-0@lo:502: Request processed in 88us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582930.300770:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787582930.300796:0:8114:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787582930.300807:0:8114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8114:1874416435741312:0@lo:502: 00000020:01000000:3.0:1787582930.300825:0:8114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582930.300835:0:8114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582930.300837:0:8114:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787582930.300843:0:8114:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff909348740800 00000020:00000080:3.0:1787582930.300875:0:8114:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787582930.300897:0:8114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8114:1874416435741440:0@lo:502: 00000100:00100000:3.0:1787582930.300935:0:8114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582930.300952:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435741440 00000100:00100000:3.0:1787582930.300955:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435741440 00000100:00100000:3.0:1787582930.300972:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787582930.300977:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:8114:x1874416435741440:12345-0@lo:502: 00000100:00100000:3.0:1787582930.301286:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:8114:x1874416435741440:12345-0@lo:502: Request processed in 307us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582930.301293:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787582930.301321:0:8114:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787582930.301333:0:8114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8114:1874416435741440:0@lo:502: 00000020:01000000:3.0:1787582930.301350:0:8114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582930.301354:0:8114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582930.301355:0:8114:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787582930.301359:0:8114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787582930.301410:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787582930.301429:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787582930.301437:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5ece expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582930.301446:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5ece expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.278304:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582931.921480:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435741568:0@lo:41: 00000100:00100000:2.0:1787582931.921548:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582931.921624:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435741568 00000100:00100000:2.0:1787582931.921631:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435741568 00000100:00100000:2.0:1787582931.921689:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787582931.921698:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435741568:12345-0@lo:41: 00000004:00000024:2.0:1787582931.921740:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787582931.921783:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435741568:12345-0@lo:41: Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582931.921804:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787582931.921869:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435741568:0@lo:41: 00010000:00010000:3.0:1787582932.302252:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582933.326470:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582933.969232:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435741696:0@lo:41: 00000100:00100000:0.0:1787582933.969303:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582933.969384:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435741696 00000100:00100000:0.0:1787582933.969391:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435741696 00000100:00100000:0.0:1787582933.969437:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787582933.969446:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435741696:12345-0@lo:41: 00000004:00000024:0.0:1787582933.969482:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787582933.969523:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435741696:12345-0@lo:41: Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582933.969530:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787582933.969588:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435741696:0@lo:41: 00000100:00100000:3.0:1787582933.973360:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435741952:0@lo:400: 00000100:00100000:3.0:1787582933.973427:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582933.973473:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787582933.973479:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435742080:0@lo:400: 00000100:00100000:3.0:1787582933.973503:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582933.973543:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435741952 00000100:00100000:3.0:1787582933.973551:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435741952 00000100:00100000:3.0:1787582933.973595:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787582933.973604:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435741952:12345-0@lo:400: 00000100:00100000:3.0:1787582933.973652:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435741952:12345-0@lo:400: Request processed in 50us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582933.973659:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787582933.973712:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff909365f14a80 x1874416435741952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582933.973725:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435741952:0@lo:400: 00000100:00100000:1.0:1787582933.973780:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435741824:0@lo:400: 00000100:00100000:1.0:1787582933.973814:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582933.973870:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787582933.973876:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435742208:0@lo:400: 00000100:00100000:1.0:1787582933.973906:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582933.973934:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435742208 00000100:00100000:1.0:1787582933.973937:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435742208 00000100:00100000:1.0:1787582933.973963:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787582933.973969:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435742208:12345-0@lo:400: 00000100:00100000:1.0:1787582933.974078:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435742208:12345-0@lo:400: Request processed in 108us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582933.974085:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787582933.974110:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff909365f17800 x1874416435742208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582933.974119:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435742208:0@lo:400: 00000100:00100000:3.0:1787582933.974350:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435741824 00000100:00100000:3.0:1787582933.974355:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435741824 00000100:00100000:3.0:1787582933.974391:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787582933.974397:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:3656:x1874416435741824:12345-0@lo:400: 00000100:00100000:3.0:1787582933.974434:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:3656:x1874416435741824:12345-0@lo:400: Request processed in 37us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582933.974440:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787582933.974513:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435741824:0@lo:400: 00000100:00100000:0.0:1787582933.974709:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435742080 00000100:00100000:0.0:1787582933.974713:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435742080 00000100:00100000:0.0:1787582933.974750:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787582933.974757:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435742080:12345-0@lo:400: 00000100:00100000:0.0:1787582933.974811:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435742080:12345-0@lo:400: Request processed in 55us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582933.974828:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787582933.974883:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435742080:0@lo:400: 00010000:00010000:2.0:1787582934.361778:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582935.375970:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582936.400451:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787582936.763783:0:8436:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787582936.763786:0:8436:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787582936.763788:0:8436:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787582936.764326:0:8436:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90936d948800 00000020:01000004:1.0:1787582936.764343:0:8436:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787582936.764355:0:8436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787582936.764368:0:8436:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff909373fdb370) 00000020:00000080:1.0:1787582936.764384:0:8436:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787582936.804910:0:8436:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787582936.804963:0:8436:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1787582936.838633:0:8436:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787582936.838890:0:8436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787582936.838901:0:8436:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787582936.838913:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19a47956376b5edc 00000020:01000004:2.0:1787582936.838920:0:8436:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787582936.838942:0:8436:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787582936.838946:0:8436:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787582936.838951:0:8436:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787582936.838955:0:8436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787582936.838966:0:8436:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90936db24d28) 00000020:00000080:2.0:1787582936.838988:0:8436:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1787582936.842394:0:8436:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787582936.842649:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787582936.842657:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787582936.849102:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787582936.849120:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787582936.854750:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787582936.854763:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787582936.868272:0:8436:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787582936.868465:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787582936.868472:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787582936.871586:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787582936.871604:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787582936.918221:0:8436:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582936.918497:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787582936.918503:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787582936.926556:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787582936.926571:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787582936.928533:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787582936.928550:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787582936.931628:0:8436:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582936.931962:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787582936.932077:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787582936.932744:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787582936.932764:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787582937.019358:0:8436:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582937.019561:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787582937.019568:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787582937.020739:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787582937.020749:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787582937.021510:0:8436:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787582937.021538:0:8436:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787582937.021545:0:8436:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000100:00100000:1.0:1787582937.038202:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435742336:0@lo:41: 00000100:00100000:1.0:1787582937.038284:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.038474:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435742336 00000100:00100000:2.0:1787582937.038483:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435742336 00000100:00100000:2.0:1787582937.038534:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787582937.038543:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435742336:12345-0@lo:41: 00000004:00000024:2.0:1787582937.038574:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787582937.038634:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435742336:12345-0@lo:41: Request processed in 92us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582937.038640:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787582937.038698:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435742336:0@lo:41: 00000040:01000000:2.0:1787582937.053194:0:8436:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787582937.053249:0:8436:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787582937.053254:0:8436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787582937.053255:0:8436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787582937.053256:0:8436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582937.053257:0:8436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582937.053258:0:8436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582937.053260:0:8436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582937.053334:0:8436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787582937.053336:0:8436:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787582937.053337:0:8436:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787582937.053339:0:8436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582937.053340:0:8436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787582937.053345:0:8436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787582937.053347:0:8436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787582937.053349:0:8436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787582937.053350:0:8436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582937.053351:0:8436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582937.053352:0:8436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582937.053353:0:8436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582937.053354:0:8436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787582937.053355:0:8436:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787582937.053356:0:8436:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787582937.053357:0:8436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582937.053358:0:8436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787582937.053391:0:8436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787582937.053408:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435742464:0@lo:253: 00000100:00100000:2.0:1787582937.053467:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.053509:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a188180 going to sleep for 11 seconds 00000100:00100000:1.0:1787582937.053618:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435742464 00000100:00100000:1.0:1787582937.053626:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435742464 00000100:00100000:1.0:1787582937.053684:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787582937.053694:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:8436:x1874416435742464:12345-0@lo:253: 20000000:01000000:1.0:1787582937.053732:0:6520:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787582937.053736:0:6520:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787582937.053741:0:6520:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787582937.053745:0:6520:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787582937.053985:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582937.054103:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787582937.054116:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787582937.054130:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787582937.054135:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787582937.054144:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787582937.054155:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787582937.054231:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787582937.054245:0:6520:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:1.0:1787582937.054247:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:1.0:1787582937.054260:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787582937.054278:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787582937.054293:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787582937.054299:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:1.0:1787582937.054310:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787582937.054316:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787582937.054327:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787582937.054341:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787582937.054408:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1787582937.054419:0:6520:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:1.0:1787582937.054422:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:1.0:1787582937.054434:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1787582937.054439:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787582937.054450:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1787582937.054454:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:1.0:1787582937.054465:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1787582937.054478:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787582937.054491:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1787582937.054516:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1787582937.054949:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1787582937.054961:0:6520:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:1.0:1787582937.054963:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:1.0:1787582937.054976:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1787582937.054982:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787582937.054994:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1787582937.054999:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:1.0:1787582937.055011:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1787582937.055016:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787582937.055027:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1787582937.055041:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1787582937.055053:0:6520:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787582937.055057:0:6520:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787582937.055061:0:6520:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787582937.055103:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787582937.055106:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787582937.056091:0:8455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1787582937.056127:0:8455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1787582937.056142:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787582937.056420:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787582937.056440:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787582937.056452:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787582937.056461:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787582937.056463:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787582937.057140:0:8456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1787582937.057167:0:8456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1787582937.057184:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1787582937.057417:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1787582937.057437:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1787582937.057451:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1787582937.057460:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787582937.057461:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787582937.061589:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787582937.062579:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787582937.062611:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787582937.062628:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787582937.062639:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787582937.062653:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787582937.063487:0:8458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1787582937.063521:0:8458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1787582937.063538:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787582937.063741:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1787582937.063763:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1787582937.063777:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:2.0:1787582937.063796:0:6520:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787582937.063814:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.063830:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909344dede00/0x19a47956376b5db6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5daf expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.063839:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909344ded000/0x19a47956376b5e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e26 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.063880:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909340030800/0x19a47956376b5e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e5e expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.063888:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367e800/0x19a47956376b5e81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e7a expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.063895:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367fa00/0x19a47956376b5eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5ea4 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.063903:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.063942:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367fa00/0x19a47956376b5eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5ea4 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.063978:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90936367fa00/0x19a47956376b5eab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5ea4 expref: 18 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.063994:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6520:1874416435742592:0@lo:104: 00000100:00100000:2.0:1787582937.064054:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582937.064107:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367e800/0x19a47956376b5e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5e7a expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.064116:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90936367e800/0x19a47956376b5e81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5e7a expref: 18 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.064124:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6520:1874416435742720:0@lo:104: 00000100:00100000:2.0:1787582937.064144:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582937.064162:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909340030800/0x19a47956376b5e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5e5e expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.064170:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909340030800/0x19a47956376b5e65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5e5e expref: 18 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.064178:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6520:1874416435742848:0@lo:104: 00000100:00100000:2.0:1787582937.064196:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582937.064210:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909344ded000/0x19a47956376b5e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5e26 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.064216:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909344ded000/0x19a47956376b5e2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5e26 expref: 18 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.064223:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6520:1874416435742976:0@lo:104: 00000100:00100000:2.0:1787582937.064247:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582937.064426:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435742592 00000100:00100000:3.0:1787582937.064433:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435742592 00000100:00100000:3.0:1787582937.064467:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435742720 00000100:00100000:3.0:1787582937.064469:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435742720 00000100:00100000:3.0:1787582937.064478:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435742848 00000100:00100000:3.0:1787582937.064481:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435742848 00000100:00100000:3.0:1787582937.064489:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435742976 00000100:00100000:3.0:1787582937.064491:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435742976 00000100:00100000:3.0:1787582937.064502:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787582937.064511:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+6:6520:x1874416435742592:12345-0@lo:104: 00010000:00010000:3.0:1787582937.064523:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b5ea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5eab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.064583:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787582937.064590:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+6:6520:x1874416435742592:12345-0@lo:104: Request processed in 80us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582937.064598:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787582937.064613:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787582937.064619:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:6520:x1874416435742720:12345-0@lo:104: 00010000:00010000:3.0:1787582937.064627:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909340031200/0x19a47956376b5e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.064669:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787582937.064674:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:6520:x1874416435742720:12345-0@lo:104: Request processed in 55us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582937.064692:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787582937.064705:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787582937.064711:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6520:x1874416435742848:12345-0@lo:104: 00010000:00010000:3.0:1787582937.064719:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.064745:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787582937.064750:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6520:x1874416435742848:12345-0@lo:104: Request processed in 40us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582937.064756:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787582937.064766:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787582937.064772:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6520:x1874416435742976:12345-0@lo:104: 00010000:00010000:3.0:1787582937.064779:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e2d expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.064800:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787582937.064805:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6520:x1874416435742976:12345-0@lo:104: Request processed in 33us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582937.064811:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787582937.064826:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787582937.064832:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b5ea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5eab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.064839:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1787582937.064877:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b5ea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5eab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.064887:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b5ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5eab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582937.064895:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b5ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5eab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582937.064902:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582937.064929:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b5ea4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5eab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.064935:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582937.064951:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b5ea4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5eab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.064957:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b5ea4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5eab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.064983:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787582937.064986:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909340031200/0x19a47956376b5e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.064992:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340031200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1787582937.064995:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909340031200/0x19a47956376b5e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5e81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065000:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909340031200/0x19a47956376b5e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5e81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582937.065015:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909340031200/0x19a47956376b5e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5e81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582937.065020:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582937.065032:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909340031200/0x19a47956376b5e7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065037:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582937.065042:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909340031200/0x19a47956376b5e7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065048:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909340031200/0x19a47956376b5e7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065056:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787582937.065058:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065063:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481c00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1787582937.065066:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5e65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065071:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5e65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582937.065076:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5e65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582937.065080:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582937.065095:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5e5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065101:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582937.065117:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5e5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065123:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5e5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065132:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582937.065134:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e2d expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065139:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344decc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1787582937.065141:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5e2d expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065147:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5e2d expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582937.065153:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5e2d expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582937.065156:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582937.065166:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5e26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e2d expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065171:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582937.065175:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5e26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e2d expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065189:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5e26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e2d expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065196:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582937.065198:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582937.065199:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582937.065218:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435743232:0@lo:103: 00000100:00100000:3.0:1787582937.065247:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582937.065280:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787582937.065286:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435743104:0@lo:103: 00000100:00100000:3.0:1787582937.065313:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582937.065338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435743232 00000100:00100000:3.0:1787582937.065341:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435743232 00010000:00010000:3.0:1787582937.065359:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367e800/0x19a47956376b5e81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e7a expref: 19 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582937.065374:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435743104 00000100:00100000:3.0:1787582937.065377:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435743104 00010000:00010000:3.0:1787582937.065384:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367fa00/0x19a47956376b5eab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5ea4 expref: 20 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582937.065393:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787582937.065398:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+20:3654:x1874416435743232:12345-0@lo:103: 00010000:00010000:3.0:1787582937.065407:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582937.065411:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367e800/0x19a47956376b5e81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e7a expref: 20 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065419:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367e800/0x19a47956376b5e81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5e7a expref: 20 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065439:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582937.065464:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+20:3654:x1874416435743232:12345-0@lo:103: Request processed in 65us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582937.065470:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787582937.065481:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787582937.065486:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245895c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3654:x1874416435743104:12345-0@lo:103: 00010000:00010000:3.0:1787582937.065492:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582937.065496:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367fa00/0x19a47956376b5eab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5ea4 expref: 19 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065503:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367fa00/0x19a47956376b5eab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5ea4 expref: 19 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.065511:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582937.065528:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245895c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3654:x1874416435743104:12345-0@lo:103: Request processed in 42us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582937.065534:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787582937.065560:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435743104:0@lo:103: 00000100:00100000:3.0:1787582937.065568:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435743232:0@lo:103: 00010000:00010000:0.0:1787582937.065803:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582937.065809:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582937.065823:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435743360:0@lo:103: 00000100:00100000:0.0:1787582937.065878:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582937.065898:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582937.065903:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435743488:0@lo:103: 00000100:00100000:0.0:1787582937.065922:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582937.065939:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435743360 00000100:00100000:0.0:1787582937.065943:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435743360 00010000:00010000:0.0:1787582937.065959:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909340030800/0x19a47956376b5e65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e5e expref: 19 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582937.065984:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435743488 00000100:00100000:0.0:1787582937.065993:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435743488 00010000:00010000:0.0:1787582937.066005:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909344ded000/0x19a47956376b5e2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e26 expref: 20 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582937.066018:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787582937.066024:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:3655:x1874416435743360:12345-0@lo:103: 00010000:00010000:0.0:1787582937.066031:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582937.066035:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909340030800/0x19a47956376b5e65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e5e expref: 20 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.066044:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909340030800/0x19a47956376b5e65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5e5e expref: 20 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.066054:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582937.066083:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:3655:x1874416435743360:12345-0@lo:103: Request processed in 59us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582937.066089:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787582937.066101:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787582937.066108:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3655:x1874416435743488:12345-0@lo:103: 00010000:00010000:0.0:1787582937.066115:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582937.066119:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909344ded000/0x19a47956376b5e2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e26 expref: 19 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.066126:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909344ded000/0x19a47956376b5e2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5e26 expref: 19 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.066134:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582937.066154:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3655:x1874416435743488:12345-0@lo:103: Request processed in 47us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582937.066160:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787582937.066191:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435743488:0@lo:103: 00000100:00100000:0.0:1787582937.066199:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435743360:0@lo:103: 00010000:00010000:2.0:1787582937.066406:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909344dede00/0x19a47956376b5db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5daf expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.066418:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909344dede00/0x19a47956376b5db6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5daf expref: 18 pid: 6520 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.066429:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6520:1874416435743616:0@lo:104: 00000100:00100000:2.0:1787582937.066455:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.066492:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a188900 going to sleep for 11 seconds 00010000:00010000:2.0:1787582937.066505:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367fa00/0x19a47956376b5eab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5ea4 expref: 18 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.066515:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6520:1874416435742592:0@lo:104: 00010000:00010000:2.0:1787582937.066524:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367e800/0x19a47956376b5e81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5e7a expref: 17 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.066533:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6520:1874416435742720:0@lo:104: 00010000:00010000:2.0:1787582937.066541:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909340030800/0x19a47956376b5e65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5e5e expref: 16 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.066549:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6520:1874416435742848:0@lo:104: 00010000:00010000:2.0:1787582937.066559:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344ded000/0x19a47956376b5e2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5e26 expref: 15 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.066567:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6520:1874416435742976:0@lo:104: 00000100:00100000:0.0:1787582937.066616:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435743616 00000100:00100000:0.0:1787582937.066621:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435743616 00000100:00100000:0.0:1787582937.066645:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787582937.066652:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245891500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6520:x1874416435743616:12345-0@lo:104: 00010000:00010000:0.0:1787582937.066661:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5db6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.066722:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787582937.066727:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245891500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6520:x1874416435743616:12345-0@lo:104: Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582937.066734:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787582937.066751:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582937.066757:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5db6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.066763:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787582937.066767:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5db6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.066775:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5db6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582937.066782:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5db6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582937.066787:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582937.066810:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5daf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5db6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.066823:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582937.066839:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5daf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5db6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.066869:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5daf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5db6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.066885:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582937.066887:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582937.066888:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582937.066898:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435743744:0@lo:103: 00000100:00100000:0.0:1787582937.066925:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582937.066959:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435743744 00000100:00100000:0.0:1787582937.066962:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435743744 00010000:00010000:0.0:1787582937.066990:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909344dede00/0x19a47956376b5db6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5daf expref: 15 pid: 6520 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582937.067003:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787582937.067008:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373f51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:3653:x1874416435743744:12345-0@lo:103: 00010000:00010000:0.0:1787582937.067014:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582937.067018:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909344dede00/0x19a47956376b5db6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5daf expref: 15 pid: 6520 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.067026:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909344dede00/0x19a47956376b5db6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5daf expref: 15 pid: 6520 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.067039:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.067057:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.067071:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.067078:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.067084:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.067090:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.067095:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344deda00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787582937.067099:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.067105:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.067113:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.067121:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582937.067149:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373f51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:3653:x1874416435743744:12345-0@lo:103: Request processed in 141us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582937.067156:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787582937.067202:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435743744:0@lo:103: 00010000:00010000:2.0:1787582937.067990:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344dede00/0x19a47956376b5db6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5daf expref: 14 pid: 6520 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.068018:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6520:1874416435743616:0@lo:104: 00010000:00010000:2.0:1787582937.068042:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.068051:0:6520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.068057:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.068063:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344deda00/0x19a47956376b5eea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787582937.068075:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787582937.073949:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:8436:x1874416435742464:12345-0@lo:253: Request processed in 20246us (20472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582937.073973:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787582937.074153:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435742464:0@lo:253: 10000000:01000000:3.0:1787582937.074169:0:8436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787582937.074172:0:8436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787582937.074174:0:8436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787582937.074175:0:8436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582937.074176:0:8436:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787582937.074178:0:8436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582937.074179:0:8436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582937.074195:0:8436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787582937.074197:0:8436:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787582937.074199:0:8436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582937.074200:0:8436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787582937.074222:0:8436:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90936d948800 from lustre-OST0000 10000000:01000000:3.0:1787582937.074281:0:8436:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787582937.074285:0:8436:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787582937.074293:0:8436:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff909343e199b8 local copy 10000000:01000000:3.0:1787582937.074298:0:8436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787582937.074337:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.074349:0:8436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582937.074358:0:8436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582937.074377:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245897800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435743872:0@lo:101: 00000100:00100000:3.0:1787582937.074411:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582937.074450:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff909241761cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582937.074569:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435743872 00000100:00100000:1.0:1787582937.074576:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435743872 00000100:00100000:1.0:1787582937.074619:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787582937.074627:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+13:8436:x1874416435743872:12345-0@lo:101: 00010000:00010000:1.0:1787582937.074639:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582937.074651:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367ec00/0x19a47956376b5ef8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5ef1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.074671:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367ec00/0x19a47956376b5ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5ef1 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.074691:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367ec00/0x19a47956376b5ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5ef1 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.074700:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367ec00, rc 0) 00000100:00100000:1.0:1787582937.074737:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435743872:12345-0@lo:101: Request processed in 111us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582937.074742:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787582937.074927:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245897800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435743872:0@lo:101: 00010000:00010000:2.0:1787582937.074939:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x19a47956376b5ef8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.074948:0:8436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19a47956376b5ef8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.075038:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744000:0@lo:501: 00000100:00100000:2.0:1787582937.075062:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.075090:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a188540 going to sleep for 11 seconds 00000100:00100000:1.0:1787582937.075130:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435744000 00000100:00100000:1.0:1787582937.075134:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435744000 00000100:00100000:1.0:1787582937.075163:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787582937.075170:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435744000:12345-0@lo:501: 00000100:00100000:1.0:1787582937.075230:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435744000:12345-0@lo:501: Request processed in 61us (166us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787582937.075236:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787582937.075445:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744000:0@lo:501: 10000000:01000000:2.0:1787582937.075463:0:8436:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787582937.075479:0:8436:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787582937.075484:0:8436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19a47956376b5ef8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.075492:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19a47956376b5ef8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.075498:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19a47956376b5ef8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.075520:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787582937.075541:0:8436:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90936d948800 10000000:01000000:2.0:1787582937.075547:0:8436:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787582937.075552:0:8436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787582937.075554:0:8436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787582937.075558:0:8436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787582937.075561:0:8436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787582937.075577:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.075584:0:8436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.075592:0:8436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.075603:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744128:0@lo:101: 00000100:00100000:2.0:1787582937.075642:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.075670:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a188480 going to sleep for 11 seconds 00010000:00010000:0.0:1787582937.075718:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582937.075724:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x19a47956376b5ef8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.075731:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481c00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787582937.075735:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x19a47956376b5ef8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.075742:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x19a47956376b5ef8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582937.075749:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x19a47956376b5ef8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582937.075754:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582937.075773:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a47956376b5ef8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.075779:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582937.075805:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a47956376b5ef8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.075812:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b5ef1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a47956376b5ef8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.075824:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582937.075826:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582937.075828:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582937.075835:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582937.075867:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435744256:0@lo:103: 00000100:00100000:0.0:1787582937.075905:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582937.075931:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435744256 00000100:00100000:0.0:1787582937.075934:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435744256 00000100:00100000:0.0:1787582937.075974:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582937.075981:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+14:3653:x1874416435744256:12345-0@lo:103: 00010000:00010000:0.0:1787582937.075990:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582937.076001:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367ec00/0x19a47956376b5ef8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b5ef1 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.076014:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582937.076042:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+13:3653:x1874416435744256:12345-0@lo:103: Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582937.076048:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582937.076076:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435744256:0@lo:103: 00000100:00100000:1.0:1787582937.076184:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435744128 00000100:00100000:1.0:1787582937.076189:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435744128 00000100:00100000:1.0:1787582937.076214:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787582937.076220:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+13:8436:x1874416435744128:12345-0@lo:101: 00010000:00010000:1.0:1787582937.076228:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582937.076238:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367e400/0x19a47956376b5f06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5eff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.076252:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367e400/0x19a47956376b5f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5eff expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.076260:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367e400/0x19a47956376b5f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5eff expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.076278:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367e400, rc 0) 00000100:00100000:1.0:1787582937.076308:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435744128:12345-0@lo:101: Request processed in 87us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582937.076313:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787582937.076616:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744128:0@lo:101: 00010000:00010000:2.0:1787582937.076639:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f06 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.076647:0:8436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5f06 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.076728:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744384:0@lo:501: 00000100:00100000:2.0:1787582937.076753:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.076784:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a188480 going to sleep for 11 seconds 00000100:00100000:1.0:1787582937.076921:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435744384 00000100:00100000:1.0:1787582937.076926:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435744384 00000100:00100000:1.0:1787582937.076950:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787582937.076956:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435744384:12345-0@lo:501: 00000100:00100000:1.0:1787582937.077063:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435744384:12345-0@lo:501: Request processed in 107us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582937.077069:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787582937.077170:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744384:0@lo:501: 00000100:00100000:0.0:1787582937.077194:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744512:0@lo:503: 00000100:00100000:0.0:1787582937.077234:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582937.077253:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582937.077411:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435744512 00000100:00100000:2.0:1787582937.077416:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435744512 00000100:00100000:2.0:1787582937.077445:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787582937.077451:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435744512:12345-0@lo:503: 00000100:00100000:2.0:1787582937.077525:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435744512:12345-0@lo:503: Request processed in 73us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582937.077531:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787582937.077601:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744512:0@lo:503: 00000040:00080000:3.0:1787582937.077910:0:8436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787582937.079248:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744640:0@lo:502: 00000100:00100000:3.0:1787582937.079382:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582937.079423:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092417616c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582937.079504:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435744640 00000100:00100000:1.0:1787582937.079510:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435744640 00000100:00100000:1.0:1787582937.079557:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787582937.079567:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435744640:12345-0@lo:502: 00000100:00100000:1.0:1787582937.079709:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435744640:12345-0@lo:502: Request processed in 143us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582937.079716:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787582937.080313:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744640:0@lo:502: 00000040:00080000:3.0:1787582937.080612:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787582937.080644:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787582937.080659:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787582937.080673:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787582937.080710:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787582937.080724:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787582937.080753:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744768:0@lo:502: 00000100:00100000:3.0:1787582937.080802:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582937.080839:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092417616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582937.081073:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435744768 00000100:00100000:0.0:1787582937.081079:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435744768 00000100:00100000:0.0:1787582937.081127:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787582937.081135:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435744768:12345-0@lo:502: 00000100:00100000:0.0:1787582937.081236:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435744768:12345-0@lo:502: Request processed in 102us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582937.081243:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787582937.081295:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744768:0@lo:502: 00000040:00080000:0.0:1787582937.081342:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787582937.081349:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787582937.081931:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787582937.081939:0:8459:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787582937.081946:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582937.081948:0:8459:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787582937.081953:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787582937.081977:0:8459:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff909343e1cd28) 00000020:00000080:0.0:1787582937.081999:0:8459:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787582937.082005:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787582937.082080:0:8459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90936d948800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787582937.082088:0:8459:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787582937.082095:0:8459:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19a47956376b5f14 00010000:00010000:0.0:1787582937.096430:0:8459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1787582937.096763:0:8459:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787582937.108237:0:8459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787582937.108748:0:8459:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787582937.126535:0:8459:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787582937.126698:0:8459:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787582937.144367:0:8459:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1787582937.149825:0:8459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787582937.149839:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582937.149872:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582937.149875:0:8459:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787582937.149878:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582937.149884:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582937.149885:0:8459:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787582937.149888:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787582937.149889:0:8459:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787582937.149919:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582937.149922:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582937.149923:0:8459:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787582937.149933:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787582937.151244:0:8436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787582937.151292:0:8436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787582937.151317:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f06 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.151329:0:8436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f06 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582937.151339:0:8436:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936d948800 from 1 10000000:01000000:1.0:1787582937.151342:0:8436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787582937.151378:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.151385:0:8436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.151395:0:8436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582937.151418:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744896:0@lo:101: 00000100:00100000:1.0:1787582937.151482:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582937.151541:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093449def00 going to sleep for 11 seconds 00000100:00100000:0.0:1787582937.152458:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435744896 00000100:00100000:0.0:1787582937.152467:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435744896 00000100:00100000:0.0:1787582937.152524:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787582937.152534:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:8436:x1874416435744896:12345-0@lo:101: 00010000:00010000:0.0:1787582937.152548:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582937.152562:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909340031a00/0x19a47956376b5f22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5f1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.152588:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909340031a00/0x19a47956376b5f22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5f1b expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.152597:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909340031a00/0x19a47956376b5f22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5f1b expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.152606:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909340031a00, rc 0) 00000100:00100000:0.0:1787582937.154097:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8436:x1874416435744896:12345-0@lo:101: Request processed in 1558us (2608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582937.154115:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787582937.154193:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435744896:0@lo:101: 00010000:00010000:0.0:1787582937.154213:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f22 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.154226:0:8436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5f22 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582937.154409:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745024:0@lo:501: 00000100:00100000:0.0:1787582937.154450:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582937.154481:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936eea66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582937.155373:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435745024 00000100:00100000:2.0:1787582937.155381:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435745024 00000100:00100000:2.0:1787582937.155430:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787582937.155438:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8436:x1874416435745024:12345-0@lo:501: 00000100:00100000:2.0:1787582937.155572:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8436:x1874416435745024:12345-0@lo:501: Request processed in 134us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582937.155579:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787582937.156121:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745024:0@lo:501: 00000100:00100000:0.0:1787582937.156162:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745152:0@lo:503: 00000100:00100000:0.0:1787582937.156208:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582937.156344:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936eea66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582937.158382:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435745152 00000100:00100000:2.0:1787582937.158395:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435745152 00000100:00100000:2.0:1787582937.158443:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787582937.158452:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8436:x1874416435745152:12345-0@lo:503: 00000100:00100000:2.0:1787582937.158620:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8436:x1874416435745152:12345-0@lo:503: Request processed in 167us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582937.158627:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787582937.158741:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745152:0@lo:503: 00000040:00080000:0.0:1787582937.161612:0:8436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787582937.161747:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745280:0@lo:502: 00000100:00100000:0.0:1787582937.161829:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582937.162247:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0813c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582937.162765:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435745280 00000100:00100000:1.0:1787582937.162775:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435745280 00000100:00100000:1.0:1787582937.162820:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787582937.162830:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8436:x1874416435745280:12345-0@lo:502: 00000100:00100000:1.0:1787582937.163255:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8436:x1874416435745280:12345-0@lo:502: Request processed in 426us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582937.163274:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787582937.163493:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745280:0@lo:502: 00000040:00080000:0.0:1787582937.163780:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787582937.163812:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787582937.163863:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745408:0@lo:502: 00000100:00100000:0.0:1787582937.163906:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582937.163941:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff909343d63600 going to sleep for 11 seconds 00000100:00100000:1.0:1787582937.165234:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435745408 00000100:00100000:1.0:1787582937.165244:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435745408 00000100:00100000:1.0:1787582937.165300:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787582937.165309:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8436:x1874416435745408:12345-0@lo:502: 00000100:00100000:1.0:1787582937.165447:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8436:x1874416435745408:12345-0@lo:502: Request processed in 138us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582937.165454:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787582937.165668:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745408:0@lo:502: 00000040:00080000:0.0:1787582937.165747:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787582937.165759:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787582937.167693:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582937.167705:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582937.167707:0:8463:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787582937.167715:0:8463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90936d948800 00000020:00000080:0.0:1787582937.167718:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787582937.167728:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582937.167731:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582937.167732:0:8463:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787582937.167735:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787582937.169340:0:8436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787582937.169373:0:8436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787582937.169424:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f22 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.169438:0:8436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f22 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582937.169493:0:8436:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787582937.169497:0:8436:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90936d948800 10000000:01000000:2.0:1787582937.169500:0:8436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90936d948800 10000000:01000000:2.0:1787582937.169504:0:8436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787582937.169511:0:8436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90936d948800 from 1 10000000:01000000:2.0:1787582937.169513:0:8436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787582937.169557:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.169565:0:8436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.169575:0:8436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.169595:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745536:0@lo:101: 00000100:00100000:2.0:1787582937.169653:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.169704:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a188180 going to sleep for 11 seconds 00000100:00100000:1.0:1787582937.169959:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435745536 00000100:00100000:1.0:1787582937.169976:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435745536 00000100:00100000:1.0:1787582937.170017:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787582937.170026:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8436:x1874416435745536:12345-0@lo:101: 00010000:00010000:1.0:1787582937.170039:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582937.170053:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367ea00/0x19a47956376b5f30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5f29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.170075:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367ea00/0x19a47956376b5f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5f29 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.170083:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367ea00/0x19a47956376b5f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5f29 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.170101:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367ea00, rc 0) 00000100:00100000:1.0:1787582937.170141:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:8436:x1874416435745536:12345-0@lo:101: Request processed in 117us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582937.170147:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787582937.170670:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745536:0@lo:101: 00010000:00010000:2.0:1787582937.170696:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f30 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.170705:0:8436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5f30 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.170802:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745664:0@lo:501: 00000100:00100000:2.0:1787582937.170832:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.170881:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a188180 going to sleep for 11 seconds 00000100:00100000:3.0:1787582937.170936:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435745664 00000100:00100000:3.0:1787582937.170940:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435745664 00000100:00100000:3.0:1787582937.170981:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787582937.170989:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:8436:x1874416435745664:12345-0@lo:501: 00000100:00100000:3.0:1787582937.171102:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:8436:x1874416435745664:12345-0@lo:501: Request processed in 113us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582937.171109:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787582937.171235:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745664:0@lo:501: 00000100:00100000:2.0:1787582937.171259:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745792:0@lo:503: 00000100:00100000:2.0:1787582937.171381:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.171442:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a188180 going to sleep for 11 seconds 00000100:00100000:3.0:1787582937.171565:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435745792 00000100:00100000:3.0:1787582937.171570:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435745792 00000100:00100000:3.0:1787582937.171630:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787582937.171638:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:8436:x1874416435745792:12345-0@lo:503: 00000100:00100000:3.0:1787582937.171736:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:8436:x1874416435745792:12345-0@lo:503: Request processed in 98us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582937.171744:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787582937.171819:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745792:0@lo:503: 00000040:00080000:0.0:1787582937.172110:0:8436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787582937.172169:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745920:0@lo:502: 00000100:00100000:0.0:1787582937.172204:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582937.172223:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff909343d630c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582937.172378:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435745920 00000100:00100000:1.0:1787582937.172383:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435745920 00000100:00100000:1.0:1787582937.172403:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787582937.172409:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:8436:x1874416435745920:12345-0@lo:502: 00000100:00100000:1.0:1787582937.172493:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:8436:x1874416435745920:12345-0@lo:502: Request processed in 82us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582937.172499:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787582937.172570:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435745920:0@lo:502: 00000040:00080000:0.0:1787582937.172777:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787582937.172802:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787582937.172815:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787582937.172828:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787582937.172841:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787582937.172888:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787582937.172902:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787582937.172914:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787582937.172925:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787582937.172937:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787582937.172951:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787582937.173045:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787582937.173058:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787582937.173071:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787582937.173083:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787582937.173095:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787582937.173107:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787582937.173134:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787582937.173150:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787582937.173162:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787582937.173175:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787582937.173187:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787582937.173200:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787582937.173214:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787582937.173227:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787582937.173239:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787582937.173249:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787582937.173259:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787582937.173353:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787582937.173366:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787582937.173378:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787582937.173389:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787582937.173401:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787582937.173424:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787582937.173437:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787582937.173449:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787582937.173460:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1787582937.173487:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435746048:0@lo:502: 00000100:00100000:0.0:1787582937.173535:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582937.173728:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582937.173826:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435746048 00000100:00100000:3.0:1787582937.173833:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435746048 00000100:00100000:3.0:1787582937.173885:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787582937.173893:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:8436:x1874416435746048:12345-0@lo:502: 00000100:00100000:3.0:1787582937.173999:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:8436:x1874416435746048:12345-0@lo:502: Request processed in 106us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582937.174006:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787582937.174187:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435746048:0@lo:502: 00000040:00080000:0.0:1787582937.174238:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787582937.174253:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787582937.175009:0:8464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787582937.175024:0:8464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff909373fdcd28) 00000020:00000080:1.0:1787582937.175042:0:8464:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787582937.175132:0:8464:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90936d948800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787582937.175136:0:8464:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90936d948800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787582937.175139:0:8464:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90936d948800 3 00010000:00080000:1.0:1787582937.175164:0:8464:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909245b03000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1787582937.199454:0:8464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1787582937.199690:0:8464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787582937.199748:0:8464:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787582937.199764:0:8464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x19a47956376b5f3e 00000100:00080000:2.0:1787582937.199775:0:8464:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787582937.199781:0:8464:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff909245b03000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787582937.199818:0:8464:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909245892d80 x1874416435746176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787582937.199836:0:8464:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787582937.199944:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874416435746176:0@lo:38: 00000100:00100000:3.0:1787582937.200030:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582937.200208:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435746176 00000100:00100000:1.0:1787582937.200217:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435746176 00000100:00100000:1.0:1787582937.200257:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582937.200265:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874416435746176:12345-0@lo:38: 00010000:00080000:1.0:1787582937.200286:0:6528:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1787582937.200313:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x19a47956376b5f45 00000004:00100000:1.0:1787582937.200327:0:6528:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787582937.200356:0:6528:0:(import.c:65:import_set_state_nolock()) ffff909245b01000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582937.200414:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874416435746176:12345-0@lo:38: Request processed in 148us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582937.200421:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582937.204490:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435746304:0@lo:400: 00000100:00100000:2.0:1787582937.204564:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.204603:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582937.204610:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435746432:0@lo:400: 00000100:00100000:2.0:1787582937.204634:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582937.204714:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435746304 00000100:00100000:3.0:1787582937.204723:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435746304 00000100:00100000:3.0:1787582937.204765:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435746432 00000100:00100000:3.0:1787582937.204768:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435746432 00000100:00100000:3.0:1787582937.204783:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787582937.204792:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435746304:12345-0@lo:400: 00000100:00100000:3.0:1787582937.204842:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435746304:12345-0@lo:400: Request processed in 51us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582937.204870:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787582937.204887:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787582937.204893:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435746432:12345-0@lo:400: 00000100:00100000:3.0:1787582937.204942:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435746432:12345-0@lo:400: Request processed in 49us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582937.204948:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787582937.207603:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435746560:0@lo:400: 00000100:00100000:2.0:1787582937.207668:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.207749:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435746560 00000100:00100000:2.0:1787582937.207757:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435746560 00000100:00100000:2.0:1787582937.207798:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787582937.207806:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435746560:12345-0@lo:400: 00000100:00100000:2.0:1787582937.207870:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435746560:12345-0@lo:400: Request processed in 65us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582937.207877:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787582937.208107:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435746560:0@lo:400: 00010000:00080000:2.0:1787582937.208138:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff909245893480 x1874416435746432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582937.208148:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435746432:0@lo:400: 00010000:00080000:2.0:1787582937.208160:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff909245893b80 x1874416435746304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582937.208180:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435746304:0@lo:400: 00000020:01000004:2.0:1787582937.208407:0:8464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787582937.208431:0:8464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9092464cb370) 00000020:00000080:2.0:1787582937.208451:0:8464:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787582937.208532:0:8464:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90936d948800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787582937.208536:0:8464:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90936d948800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787582937.208539:0:8464:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90936d948800 3 00010000:00080000:2.0:1787582937.208566:0:8464:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909365f3d800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1787582937.210963:0:8464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00010000:00080000:3.0:1787582937.211103:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff909245892d80 x1874416435746176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787582947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582937.211118:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787582937.211129:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787582937.211137:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787582937.211143:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787582937.211146:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909245b03000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787582937.211153:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874416435746176:0@lo:38: 00000020:00000080:2.0:1787582937.215407:0:8464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787582937.215444:0:8464:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787582937.215455:0:8464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x19a47956376b5f53 00000100:00080000:2.0:1787582937.215465:0:8464:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787582937.215471:0:8464:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff909365f3d800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787582937.215506:0:8464:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909245893b80 x1874416435746688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787582937.215523:0:8464:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787582937.217559:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874416435746688:0@lo:38: 00000100:00100000:3.0:1787582937.217636:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582937.217773:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435746688 00000100:00100000:1.0:1787582937.217781:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435746688 00000100:00100000:1.0:1787582937.217871:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787582937.217879:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874416435746688:12345-0@lo:38: 00010000:00080000:1.0:1787582937.217909:0:6529:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1787582937.218046:0:6529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x19a47956376b5f5a 00000004:00100000:1.0:1787582937.218062:0:6529:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787582937.218095:0:6529:0:(import.c:65:import_set_state_nolock()) ffff909245b07800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582937.218147:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874416435746688:12345-0@lo:38: Request processed in 267us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582937.218155:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1787582937.218302:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1787582937.220250:0:8436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787582937.220295:0:8436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787582937.220312:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f30 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582937.220326:0:8436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f30 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787582937.220385:0:8436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787582937.220387:0:8436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787582937.220388:0:8436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787582937.220390:0:8436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787582937.220391:0:8436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787582937.220393:0:8436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787582937.220394:0:8436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787582937.220395:0:8436:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787582937.220397:0:8436:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787582937.220399:0:8436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787582937.220400:0:8436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787582937.220404:0:8436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787582937.220407:0:8436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787582937.220409:0:8436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787582937.220410:0:8436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787582937.220411:0:8436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787582937.220412:0:8436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787582937.220414:0:8436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787582937.220415:0:8436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787582937.220416:0:8436:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787582937.220417:0:8436:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787582937.220418:0:8436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787582937.220419:0:8436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787582937.220447:0:8436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787582937.220467:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435746816:0@lo:253: 00000100:00100000:0.0:1787582937.220536:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582937.220576:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582937.222123:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435746816 00000100:00100000:3.0:1787582937.222143:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435746816 00000100:00100000:3.0:1787582937.222197:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787582937.222208:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:8436:x1874416435746816:12345-0@lo:253: 20000000:01000000:3.0:1787582937.222240:0:6521:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787582937.222255:0:6521:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1787582937.226008:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff909245893b80 x1874416435746688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787582947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582937.226024:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787582937.226034:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787582937.226044:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787582937.226050:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787582937.226053:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909365f3d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787582937.226060:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874416435746688:0@lo:38: 20000000:01000000:3.0:1787582937.234642:0:6521:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787582937.234706:0:6521:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787582937.235131:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:8436:x1874416435746816:12345-0@lo:253: Request processed in 12921us (14591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582937.235143:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787582937.235262:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:8436:1874416435746816:0@lo:253: 10000000:01000000:0.0:1787582937.235277:0:8436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787582937.235280:0:8436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787582937.235282:0:8436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787582937.235284:0:8436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787582937.235285:0:8436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787582937.235287:0:8436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787582937.235288:0:8436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787582937.235290:0:8436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787582937.235291:0:8436:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787582937.235292:0:8436:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787582937.235294:0:8436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787582937.235295:0:8436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787582937.235308:0:8436:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787582937.237092:0:6543:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787582937.237104:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787582937.237131:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.237149:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909340031c00/0x19a47956376b5e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e50 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.237156:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367e000/0x19a47956376b5e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5e6c expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.237164:0:6543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.237209:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367e000/0x19a47956376b5e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5e6c expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.237246:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90936367e000/0x19a47956376b5e73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5e6c expref: 15 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582937.237262:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435746944:0@lo:104: 00000100:00100000:1.0:1787582937.237325:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787582937.237385:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909340031c00/0x19a47956376b5e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5e50 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.237392:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909340031c00/0x19a47956376b5e57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5e50 expref: 15 pid: 6520 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582937.237401:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435747072:0@lo:104: 00000100:00100000:1.0:1787582937.237418:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093449dee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582937.239034:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787582937.239072:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.239108:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435746944 00000100:00100000:2.0:1787582937.239117:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435746944 00000100:00100000:2.0:1787582937.239155:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435747072 00000100:00100000:2.0:1787582937.239159:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435747072 00000100:00100000:2.0:1787582937.239173:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787582937.239180:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f0ad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6543:x1874416435746944:12345-0@lo:104: 00010000:00010000:2.0:1787582937.239195:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909340031600/0x19a47956376b5e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239285:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787582937.239291:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f0ad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6543:x1874416435746944:12345-0@lo:104: Request processed in 112us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582937.239298:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787582937.239333:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787582937.239340:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245893480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6543:x1874416435747072:12345-0@lo:104: 00010000:00010000:2.0:1787582937.239348:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239380:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787582937.239386:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245893480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6543:x1874416435747072:12345-0@lo:104: Request processed in 47us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582937.239392:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787582937.239435:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435746944:0@lo:104: 00000100:00100000:2.0:1787582937.239444:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435747072:0@lo:104: 00010000:00010000:2.0:1787582937.239463:0:6543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239480:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787582937.239487:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909340031600/0x19a47956376b5e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239494:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340031600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787582937.239499:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909340031600/0x19a47956376b5e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5e73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239507:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909340031600/0x19a47956376b5e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5e73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582937.239521:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909340031600/0x19a47956376b5e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5e73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582937.239527:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787582937.239558:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909340031600/0x19a47956376b5e6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239565:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582937.239582:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909340031600/0x19a47956376b5e6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239588:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909340031600/0x19a47956376b5e6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239601:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582937.239604:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5e57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239610:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787582937.239613:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5e57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239620:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5e57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582937.239626:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5e57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582937.239631:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787582937.239651:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5e50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239657:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582937.239671:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5e50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239692:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5e50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5e57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.239707:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582937.239709:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582937.239710:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582937.239717:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582937.239736:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435747200:0@lo:103: 00000100:00100000:2.0:1787582937.239767:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.239804:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435747328:0@lo:103: 00000100:00100000:2.0:1787582937.239825:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582937.239879:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435747200 00000100:00100000:2.0:1787582937.240736:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435747200 00010000:00010000:2.0:1787582937.240778:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367e000/0x19a47956376b5e73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e6c expref: 16 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.241041:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435747328 00000100:00100000:2.0:1787582937.241047:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435747328 00010000:00010000:2.0:1787582937.241061:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909340031c00/0x19a47956376b5e57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e50 expref: 17 pid: 6520 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787582937.241805:0:8436:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787582937.242501:0:8436:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787582937.243270:0:8436:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787582937.243437:0:8436:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787582937.243664:0:8436:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787582937.244135:0:8436:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1787582937.244547:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787582937.244562:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:3654:x1874416435747200:12345-0@lo:103: 00010000:00010000:1.0:1787582937.244581:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582937.244592:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367e000/0x19a47956376b5e73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e6c expref: 17 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244606:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367e000/0x19a47956376b5e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5e6c expref: 17 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244624:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367e000/0x19a47956376b5e73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5e6c expref: 17 pid: 6522 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244639:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582937.244665:0:6514:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787582937.244673:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787582937.244751:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:3654:x1874416435747200:12345-0@lo:103: Request processed in 194us (4983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582937.244770:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787582937.244791:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787582937.244797:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:3655:x1874416435747328:12345-0@lo:103: 00010000:00010000:1.0:1787582937.244804:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582937.244809:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909340031c00/0x19a47956376b5e57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5e50 expref: 15 pid: 6520 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.244816:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435747200:0@lo:103: 00010000:00010000:1.0:1787582937.244817:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909340031c00/0x19a47956376b5e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5e50 expref: 15 pid: 6520 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244826:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909340031c00/0x19a47956376b5e57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5e50 expref: 15 pid: 6520 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244861:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244869:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787582937.244883:0:6512:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007781536s 00010000:00010000:1.0:1787582937.244888:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244895:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244902:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244909:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244921:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f200 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787582937.244925:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244933:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244952:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582937.244963:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582937.244991:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+14:3655:x1874416435747328:12345-0@lo:103: Request processed in 194us (5165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582937.244998:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787582937.245052:0:6543:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.245060:0:6543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582937.245065:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367f200/0x19a47956376b5f61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582937.245093:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435747328:0@lo:103: 00000001:00000004:0.0:1787582937.246378:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787582937.253550:0:8436:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787582937.253572:0:8436:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787582937.253608:0:8436:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787582937.253645:0:8436:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787582937.253665:0:8436:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787582937.253692:0:8436:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787582937.257501:0:8436:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787582937.257691:0:8436:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787582937.422916:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787582938.303630:0:8521:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787582938.304475:0:8521:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787582938.446987:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582939.090974:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435747456:0@lo:41: 00000100:00100000:0.0:1787582939.091050:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.091202:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435747456 00000100:00100000:2.0:1787582939.091210:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435747456 00000100:00100000:2.0:1787582939.091264:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787582939.091274:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435747456:12345-0@lo:41: 00000004:00000024:2.0:1787582939.091309:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787582939.091361:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435747456:12345-0@lo:41: Request processed in 89us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582939.091368:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787582939.091416:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435747456:0@lo:41: 00010000:00010000:3.0:1787582939.471183:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582940.494545:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582941.520547:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582942.163555:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787582942.163582:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435747584:0@lo:41: 00000100:00100000:3.0:1787582942.163682:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.163759:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435747584 00000100:00100000:3.0:1787582942.163766:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435747584 00000100:00100000:3.0:1787582942.163809:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787582942.163819:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435747584:12345-0@lo:41: 00000004:00000024:3.0:1787582942.163871:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1787582942.163914:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435747584:12345-0@lo:41: Request processed in 97us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582942.163921:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787582942.163959:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435747584:0@lo:41: 00010000:00010000:3.0:1787582942.553387:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787582942.673350:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787582942.673360:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90936d90b000 from 30 10000000:01000000:2.0:1787582942.673367:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787582942.674526:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582942.674542:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582942.674576:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582942.674602:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435747712:0@lo:101: 00000100:00100000:2.0:1787582942.674750:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582942.674811:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787582942.677207:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435747712 00000100:00100000:0.0:1787582942.677223:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435747712 00000100:00100000:0.0:1787582942.677291:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787582942.677301:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+14:6525:x1874416435747712:12345-0@lo:101: 00010000:00010000:0.0:1787582942.677319:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582942.677335:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909340031c00/0x19a47956376b5f6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5f68 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.677362:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909340031c00/0x19a47956376b5f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5f68 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.677373:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909340031c00/0x19a47956376b5f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5f68 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.677382:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909340031c00, rc 0) 00000100:00100000:0.0:1787582942.677521:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435747712:12345-0@lo:101: Request processed in 221us (2770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.677528:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787582942.677583:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435747712:0@lo:101: 00010000:00010000:0.0:1787582942.677605:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f6f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.677614:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5f6f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582942.677753:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435747840:0@lo:501: 00000100:00100000:0.0:1787582942.677791:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.678028:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787582942.678044:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435747840 00000100:00100000:0.0:1787582942.678048:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435747840 00000100:00100000:0.0:1787582942.678075:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787582942.678156:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435747840:12345-0@lo:501: 00000100:00100000:0.0:1787582942.678284:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435747840:12345-0@lo:501: Request processed in 130us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.678292:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787582942.678326:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435747840:0@lo:501: 00000100:00100000:0.0:1787582942.678356:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435747968:0@lo:503: 00000100:00100000:0.0:1787582942.679307:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.679343:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582942.680736:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435747968 00000100:00100000:2.0:1787582942.680748:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435747968 00000100:00100000:2.0:1787582942.680816:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787582942.680826:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435747968:12345-0@lo:503: 00000100:00100000:2.0:1787582942.680990:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435747968:12345-0@lo:503: Request processed in 165us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582942.680998:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787582942.681053:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435747968:0@lo:503: 00000100:00100000:0.0:1787582942.685377:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582942.685416:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435748096:0@lo:400: 00000100:00100000:0.0:1787582942.685481:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.685531:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435748096 00000100:00100000:0.0:1787582942.685539:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435748096 00000100:00100000:0.0:1787582942.685584:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787582942.685592:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435748096:12345-0@lo:400: 00000100:00100000:1.0:1787582942.685906:0:8744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8744:1874416435748224:0@lo:502: 00000100:00100000:1.0:1787582942.685951:0:8744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582942.685978:0:8744:0:(client.c:2715:ptlrpc_set_wait()) set ffff90934562bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582942.686196:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435748096:12345-0@lo:400: Request processed in 603us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.686204:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787582942.686234:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435748224 00000100:00100000:0.0:1787582942.686238:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435748224 00000100:00100000:0.0:1787582942.686263:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787582942.686270:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8744:x1874416435748224:12345-0@lo:502: 00000100:00100000:0.0:1787582942.686381:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8744:x1874416435748224:12345-0@lo:502: Request processed in 111us (429us total) trans 0 rc 0/0 00010000:00080000:1.0:1787582942.686495:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909377f0dc00 x1874416435748096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582942.686510:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435748096:0@lo:400: 00000100:00100000:1.0:1787582942.686538:0:8744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8744:1874416435748224:0@lo:502: 00000100:00100000:1.0:1787582942.686583:0:8744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8744:1874416435748352:0@lo:502: 00000100:00100000:1.0:1787582942.686615:0:8744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.686834:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787582942.686878:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435748352 00000100:00100000:0.0:1787582942.686883:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435748352 00000100:00100000:0.0:1787582942.686899:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787582942.686906:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8744:x1874416435748352:12345-0@lo:502: 00000100:00100000:0.0:1787582942.686971:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:8744:x1874416435748352:12345-0@lo:502: Request processed in 65us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.686977:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787582942.687046:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787582942.687055:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435748480:0@lo:400: 00000100:00100000:1.0:1787582942.687178:0:8744:0:(client.c:2715:ptlrpc_set_wait()) set ffff90934562bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787582942.687200:0:8744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8744:1874416435748352:0@lo:502: 00000040:00080000:1.0:1787582942.687222:0:8744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787582942.687280:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787582942.687299:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787582942.687309:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f6f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582942.687319:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f6f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582942.687329:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787582942.687331:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90936d90b000 from 5 10000000:01000000:1.0:1787582942.687334:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787582942.687361:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582942.687368:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582942.687377:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582942.687524:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.687617:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435748736:0@lo:400: 00000100:00100000:0.0:1787582942.687662:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.687694:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435748736 00000100:00100000:0.0:1787582942.687699:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435748736 00000100:00100000:0.0:1787582942.687727:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787582942.687735:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435748736:12345-0@lo:400: 00000100:00100000:0.0:1787582942.687788:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435748736:12345-0@lo:400: Request processed in 54us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.687802:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787582942.687834:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435748736:0@lo:400: 00000100:00100000:0.0:1787582942.687889:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435748864:0@lo:400: 00000100:00100000:0.0:1787582942.687917:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582942.687958:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435748608:0@lo:101: 00000100:00100000:1.0:1787582942.687987:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582942.688010:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90934562bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582942.688496:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435748608 00000100:00100000:0.0:1787582942.688501:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435748608 00000100:00100000:0.0:1787582942.688526:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787582942.688533:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435748608:12345-0@lo:101: 00010000:00010000:0.0:1787582942.688543:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582942.688559:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909340031600/0x19a47956376b5f7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5f76 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.688580:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909340031600/0x19a47956376b5f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5f76 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.688589:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909340031600/0x19a47956376b5f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5f76 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.688598:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909340031600, rc 0) 00000100:00100000:0.0:1787582942.688729:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435748608:12345-0@lo:101: Request processed in 197us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.688736:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787582942.688786:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435748608:0@lo:101: 00010000:00010000:0.0:1787582942.688799:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.688808:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5f7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582942.688893:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435748992:0@lo:256: 00000100:00100000:0.0:1787582942.688925:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.688939:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465f5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582942.688951:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435748992 00000100:00100000:0.0:1787582942.688954:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435748992 00000100:00100000:0.0:1787582942.688975:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787582942.688981:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435748992:12345-0@lo:256: 20000000:01000000:0.0:1787582942.688995:0:6521:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787582942.689013:0:6521:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787582942.689016:0:6521:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787582942.689228:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435748992:12345-0@lo:256: Request processed in 245us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.689236:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787582942.689266:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435748992:0@lo:256: 10000000:01000000:0.0:1787582942.689305:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787582942.689312:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.689320:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582942.689327:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787582942.689330:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1787582942.689332:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787582942.689348:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.689364:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.689372:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582942.689393:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435749120:0@lo:101: 00000100:00100000:0.0:1787582942.689418:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.689432:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465f5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582942.689445:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435749120 00000100:00100000:0.0:1787582942.689448:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435749120 00000100:00100000:0.0:1787582942.689469:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787582942.689475:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435749120:12345-0@lo:101: 00010000:00010000:0.0:1787582942.689482:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582942.689490:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909340031200/0x19a47956376b5f8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5f84 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.689503:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909340031200/0x19a47956376b5f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5f84 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.689511:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909340031200/0x19a47956376b5f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5f84 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.689517:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909340031200, rc 0) 00000100:00100000:0.0:1787582942.689558:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435749120:12345-0@lo:101: Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.689565:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787582942.689883:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435749120:0@lo:101: 00010000:00010000:0.0:1787582942.689901:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582942.689909:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5f8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582942.689961:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435749248:0@lo:501: 00000100:00100000:0.0:1787582942.689992:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.690020:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465f5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582942.690032:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435749248 00000100:00100000:0.0:1787582942.690036:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435749248 00000100:00100000:0.0:1787582942.690058:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787582942.690064:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435749248:12345-0@lo:501: 00000100:00100000:0.0:1787582942.690262:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435749248:12345-0@lo:501: Request processed in 197us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.690269:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787582942.690317:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435749248:0@lo:501: 00000100:00100000:0.0:1787582942.690343:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435749376:0@lo:503: 00000100:00100000:0.0:1787582942.690381:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582942.690465:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435748480 00000100:00100000:2.0:1787582942.690470:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435748480 00000100:00100000:2.0:1787582942.690503:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435748864 00000100:00100000:2.0:1787582942.690507:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435748864 00000100:00100000:2.0:1787582942.690542:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787582942.690549:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435748480:12345-0@lo:400: 00000100:00100000:2.0:1787582942.690593:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435748480:12345-0@lo:400: Request processed in 45us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582942.690600:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787582942.690613:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787582942.690620:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435748864:12345-0@lo:400: 00000100:00100000:0.0:1787582942.690723:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465f5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582942.690735:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435749376 00000100:00100000:0.0:1787582942.690739:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435749376 00000100:00100000:0.0:1787582942.690836:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787582942.690864:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435749376:12345-0@lo:503: 00000100:00100000:0.0:1787582942.690959:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435749376:12345-0@lo:503: Request processed in 115us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.690966:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787582942.691016:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435749376:0@lo:503: 00000100:00100000:2.0:1787582942.691199:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435748864:12345-0@lo:400: Request processed in 579us (3280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582942.691213:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787582942.691247:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787582942.691278:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909377f0ca80 x1874416435748864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582942.691290:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435748864:0@lo:400: 00010000:00080000:2.0:1787582942.691319:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909377f0c380 x1874416435748480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582942.691329:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435748480:0@lo:400: 00000100:00100000:2.0:1787582942.691593:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435749504:0@lo:400: 00000100:00100000:2.0:1787582942.691706:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.691893:0:8745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8745:1874416435749632:0@lo:502: 00000100:00100000:0.0:1787582942.691930:0:8745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.691950:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435749632 00000100:00100000:0.0:1787582942.691955:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435749632 00000100:00100000:0.0:1787582942.691980:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787582942.691988:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:8745:x1874416435749632:12345-0@lo:502: 00000100:00100000:0.0:1787582942.692154:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:8745:x1874416435749632:12345-0@lo:502: Request processed in 90us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.692162:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787582942.692212:0:8745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787582942.692227:0:8745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8745:1874416435749632:0@lo:502: 00000020:01000000:0.0:1787582942.692250:0:8745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787582942.692258:0:8745:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787582942.692265:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582942.692268:0:8745:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787582942.692272:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787582942.692276:0:8745:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1787582942.692297:0:8745:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787582942.692303:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787582942.692323:0:8745:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9092466899b8) 00000020:00000080:0.0:1787582942.692345:0:8745:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1787582942.692352:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787582942.692519:0:8745:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787582942.692527:0:8745:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787582942.692535:0:8745:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x19a47956376b5f99 00010000:00080000:0.0:1787582942.692566:0:8745:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909246692000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1787582942.693008:0:8745:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000100:00100000:1.0:1787582942.693188:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435749504 00000100:00100000:1.0:1787582942.693195:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435749504 00000100:00100000:1.0:1787582942.693242:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787582942.693252:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435749504:12345-0@lo:400: 00000100:00080000:0.0:1787582942.694280:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787582942.694433:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435749504:12345-0@lo:400: Request processed in 1178us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582942.694450:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787582942.694560:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90924667d500 x1874416435749504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582942.694576:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435749504:0@lo:400: 00000040:01000000:2.0:1787582942.707491:0:8745:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787582942.707519:0:8745:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787582942.707798:0:8745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582942.708365:0:8745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582942.708549:0:8745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787582942.708714:0:8745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787582942.713530:0:8746:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787582942.713539:0:8746:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787582942.714559:0:8745:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787582942.714572:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787582942.714616:0:8745:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787582942.714656:0:8745:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b5fa0 00000100:00080000:2.0:1787582942.714667:0:8745:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787582942.714673:0:8745:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff909246692000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787582942.714711:0:8745:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909245890e00 x1874416435749760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787582942.714746:0:8745:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787582942.714945:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435749760:0@lo:8: 00000100:00100000:1.0:1787582942.715012:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787582942.715609:0:8745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582942.715614:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582942.715616:0:8745:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787582942.715618:0:8745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582942.715622:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582942.715623:0:8745:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787582942.715626:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787582942.715628:0:8745:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787582942.715670:0:8745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8745:1874416435749888:0@lo:502: 00000100:00100000:2.0:1787582942.715718:0:8745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582942.715735:0:8745:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582942.715753:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435749888 00000100:00100000:2.0:1787582942.715983:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435749888 00000100:00100000:2.0:1787582942.716027:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787582942.716036:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:8745:x1874416435749888:12345-0@lo:502: 00000100:00100000:2.0:1787582942.716270:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:8745:x1874416435749888:12345-0@lo:502: Request processed in 234us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582942.716278:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787582942.716336:0:8745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8745:1874416435749888:0@lo:502: 00000020:01000000:2.0:1787582942.716361:0:8745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582942.716365:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582942.716367:0:8745:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787582942.716370:0:8745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1787582942.716729:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1787582942.716752:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787582942.716772:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582942.716794:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5f8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582942.716804:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787582942.716807:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff909348740800 from 30 10000000:01000000:2.0:1787582942.716810:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787582942.716836:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582942.716872:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582942.716882:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582942.716898:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435750016:0@lo:101: 00000100:00100000:2.0:1787582942.717069:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582942.717166:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582942.717352:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435750016 00000100:00100000:1.0:1787582942.717358:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435750016 00000100:00100000:1.0:1787582942.717404:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787582942.717413:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435750016:12345-0@lo:101: 00010000:00010000:1.0:1787582942.717423:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582942.717434:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367fa00/0x19a47956376b5fae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5fa7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582942.717455:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367fa00/0x19a47956376b5fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5fa7 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582942.717464:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367fa00/0x19a47956376b5fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5fa7 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582942.717473:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367fa00, rc 0) 00000100:00100000:1.0:1787582942.717508:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435750016:12345-0@lo:101: Request processed in 97us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582942.717514:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787582942.717742:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435750016:0@lo:101: 00010000:00010000:2.0:1787582942.717764:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582942.717774:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582942.717822:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435750144:0@lo:501: 00000100:00100000:2.0:1787582942.717874:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582942.717900:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582942.717920:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435750144 00000100:00100000:2.0:1787582942.717923:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435750144 00000100:00100000:1.0:1787582942.718028:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435749760 00000100:00100000:1.0:1787582942.718033:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435749760 00000100:00100000:1.0:1787582942.718053:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582942.718058:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874416435749760:12345-0@lo:8: 00010000:00080000:1.0:1787582942.718089:0:8442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:1.0:1787582942.718119:0:8442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b5fb5 00002000:00100000:1.0:1787582942.718158:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff909245b03800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787582942.718162:0:8442:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1787582942.718165:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787582942.718225:0:8442:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787582942.718462:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787582942.718487:0:8442:0:(import.c:65:import_set_state_nolock()) ffff909245b01800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582942.718539:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1874416435749760:12345-0@lo:8: Request processed in 480us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582942.718545:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787582942.718579:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245890e00 x1874416435749760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787582952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582942.718589:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787582942.718596:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787582942.718603:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787582942.718608:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787582942.718611:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909246692000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787582942.718622:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787582942.718627:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435749760:0@lo:8: 00000004:00080000:1.0:1787582942.718667:0:8746:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787582942.718711:0:8746:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 249871864726ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787582942.718717:0:8746:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787582942.719007:0:8747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1874416435750272:0@lo:700: 00000100:00100000:1.0:1787582942.719033:0:8747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582942.719059:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435750272 00000100:00100000:1.0:1787582942.719063:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435750272 00000100:00100000:1.0:1787582942.719101:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582942.719114:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8747:x1874416435750272:12345-0@lo:700: 00000100:00100000:1.0:1787582942.719138:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8451:1874416435750400:0@lo:700: 00000100:00100000:1.0:1787582942.719165:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582942.719180:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff90934562b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787582942.719191:0:8747:0:(client.c:2715:ptlrpc_set_wait()) set ffff90934562b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787582942.720059:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787582942.720068:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435750144:12345-0@lo:501: 00000100:00100000:2.0:1787582942.720223:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435750144:12345-0@lo:501: Request processed in 155us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582942.720231:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787582942.720271:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435750400 00000100:00100000:2.0:1787582942.720276:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435750400 00000100:00100000:2.0:1787582942.720300:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787582942.720307:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8451:x1874416435750400:12345-0@lo:700: 00000100:00100000:2.0:1787582942.720717:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435750144:0@lo:501: 00000100:00100000:2.0:1787582942.720764:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435750528:0@lo:503: 00000100:00100000:2.0:1787582942.720811:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582942.720834:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582942.720858:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435750528 00000100:00100000:2.0:1787582942.720861:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435750528 00000100:00100000:2.0:1787582942.720881:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787582942.720887:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435750528:12345-0@lo:503: 00000100:00100000:2.0:1787582942.721136:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435750528:12345-0@lo:503: Request processed in 248us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582942.721143:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787582942.721177:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435750528:0@lo:503: 00000100:00100000:2.0:1787582942.721340:0:8748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8748:1874416435750656:0@lo:502: 00000100:00100000:2.0:1787582942.721368:0:8748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.722345:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435750656 00000100:00100000:3.0:1787582942.722352:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435750656 00000100:00100000:3.0:1787582942.722396:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787582942.722404:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+18:8748:x1874416435750656:12345-0@lo:502: 00000100:00100000:2.0:1787582942.722645:0:8748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736c1000 going to sleep for 11 seconds 00000004:00080000:1.0:1787582942.723560:0:7459:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:0.0:1787582942.723677:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582942.732351:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+18:8748:x1874416435750656:12345-0@lo:502: Request processed in 9938us (10971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582942.732366:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787582942.732608:0:8748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8748:1874416435750656:0@lo:502: 00000100:00100000:3.0:1787582942.732744:0:8748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8748:1874416435750784:0@lo:502: 00000100:00100000:3.0:1787582942.732878:0:8748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.732908:0:8748:0:(client.c:2715:ptlrpc_set_wait()) set ffff909241761840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582942.733007:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435750784 00000100:00100000:2.0:1787582942.733015:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435750784 00000100:00100000:2.0:1787582942.733055:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787582942.733065:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:8748:x1874416435750784:12345-0@lo:502: 00000100:00100000:2.0:1787582942.733192:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:8748:x1874416435750784:12345-0@lo:502: Request processed in 128us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582942.733198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787582942.733334:0:8748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8748:1874416435750784:0@lo:502: 00000040:00080000:3.0:1787582942.733356:0:8748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787582942.734100:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787582942.734123:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787582942.734132:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582942.734144:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582942.734154:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787582942.734157:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff909348740800 from 5 10000000:01000000:2.0:1787582942.734159:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787582942.734186:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582942.734194:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582942.734202:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582942.734217:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435750912:0@lo:101: 00000100:00100000:2.0:1787582942.734261:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582942.734297:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736c1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787582942.735173:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435750912 00000100:00100000:3.0:1787582942.735181:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435750912 00000100:00100000:3.0:1787582942.735223:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787582942.735232:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435750912:12345-0@lo:101: 00010000:00010000:3.0:1787582942.735244:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582942.735256:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909341481800/0x19a47956376b5fc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5fbc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.735276:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909341481800/0x19a47956376b5fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5fbc expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.735287:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909341481800/0x19a47956376b5fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5fbc expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.735295:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481800, rc 0) 00000100:00100000:3.0:1787582942.735336:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435750912:12345-0@lo:101: Request processed in 106us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582942.735342:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 40000000:02000000:0.0:1787582942.735534:0:6534:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1787582942.735975:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435750912:0@lo:101: 00010000:00010000:3.0:1787582942.735991:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5fc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.736000:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5fc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582942.736050:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435751040:0@lo:256: 00000100:00100000:3.0:1787582942.736145:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.736163:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909241761180 going to sleep for 11 seconds 00000100:00100000:3.0:1787582942.736178:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435751040 00000100:00100000:3.0:1787582942.736182:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435751040 00000100:00100000:3.0:1787582942.736204:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787582942.736210:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435751040:12345-0@lo:256: 20000000:01000000:3.0:1787582942.736223:0:6522:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787582942.736239:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787582942.736242:0:6522:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787582942.736300:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435751040:12345-0@lo:256: Request processed in 90us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582942.736307:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787582942.736334:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435751040:0@lo:256: 10000000:01000000:3.0:1787582942.736372:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787582942.736378:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5fc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.736613:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5fc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582942.736696:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787582942.736700:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787582942.736702:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787582942.736722:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.736730:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.736738:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582942.736749:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435751168:0@lo:101: 00000100:00100000:3.0:1787582942.736906:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.736923:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909241761180 going to sleep for 11 seconds 00000100:00100000:3.0:1787582942.736936:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435751168 00000100:00100000:3.0:1787582942.736940:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435751168 00000100:00100000:3.0:1787582942.736965:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787582942.736971:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435751168:12345-0@lo:101: 00010000:00010000:3.0:1787582942.736978:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582942.736987:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909341480000/0x19a47956376b5fd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5fca expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.737003:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909341480000/0x19a47956376b5fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5fca expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.737011:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909341480000/0x19a47956376b5fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5fca expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.737029:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480000, rc 0) 00000100:00100000:3.0:1787582942.737053:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435751168:12345-0@lo:101: Request processed in 83us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582942.737059:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787582942.737464:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435751168:0@lo:101: 00010000:00010000:3.0:1787582942.737475:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5fd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.737482:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5fd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582942.737533:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435751296:0@lo:501: 00000100:00100000:3.0:1787582942.737554:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.737576:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909241761180 going to sleep for 11 seconds 00000100:00100000:3.0:1787582942.737587:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435751296 00000100:00100000:3.0:1787582942.737590:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435751296 00000100:00100000:3.0:1787582942.737612:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787582942.737617:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435751296:12345-0@lo:501: 00000100:00100000:3.0:1787582942.739315:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435751296:12345-0@lo:501: Request processed in 1690us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582942.739327:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787582942.739378:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435751296:0@lo:501: 00000100:00100000:3.0:1787582942.740325:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435751424:0@lo:503: 00000100:00100000:3.0:1787582942.740838:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.740912:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909241761180 going to sleep for 11 seconds 00000100:00100000:2.0:1787582942.741195:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435751424 00000100:00100000:2.0:1787582942.741203:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435751424 00000100:00100000:2.0:1787582942.741251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787582942.741260:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435751424:12345-0@lo:503: 00000100:00100000:2.0:1787582942.741374:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435751424:12345-0@lo:503: Request processed in 114us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582942.741382:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787582942.741721:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435751424:0@lo:503: 00000100:00100000:3.0:1787582942.743704:0:8749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8749:1874416435751552:0@lo:502: 00000100:00100000:3.0:1787582942.744032:0:8749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.744071:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435751552 00000100:00100000:3.0:1787582942.744701:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435751552 00000100:00100000:3.0:1787582942.744984:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787582942.744997:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+20:8749:x1874416435751552:12345-0@lo:502: 00000100:00100000:3.0:1787582942.746246:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+20:8749:x1874416435751552:12345-0@lo:502: Request processed in 1247us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582942.746257:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787582942.746324:0:8749:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582942.746348:0:8749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8749:1874416435751552:0@lo:502: 00000020:01000000:3.0:1787582942.746381:0:8749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787582942.747170:0:8749:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787582942.747178:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582942.747180:0:8749:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787582942.747187:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787582942.747191:0:8749:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:3.0:1787582942.747215:0:8749:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787582942.747218:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787582942.747254:0:8749:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9092467919b8) 00000020:00000080:3.0:1787582942.747280:0:8749:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1787582942.747287:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787582942.748715:0:8749:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787582942.748728:0:8749:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787582942.748739:0:8749:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b5fdf 00010000:00080000:3.0:1787582942.748826:0:8749:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90936d8a3800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1787582942.750016:0:8749:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1787582942.758946:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8451:x1874416435750400:12345-0@lo:700: Request processed in 38631us (39772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.758965:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787582942.759417:0:8451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90936d83b480 x1874416435750400/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787582958 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582942.759435:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8451:1874416435750400:0@lo:700: 40000000:02000000:0.0:1787582942.759449:0:8451:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00100000:0.0:1787582942.771252:0:8437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787582942.771375:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8747:x1874416435750272:12345-0@lo:700: Request processed in 52257us (52336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.771400:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:2.0:1787582942.771546:0:8749:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787582942.771566:0:8749:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787582942.771935:0:8749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582942.772206:0:8749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582942.772311:0:8749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00010000:00080000:0.0:1787582942.772570:0:8747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90936d839880 x1874416435750272/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787582958 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582942.772586:0:8747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1874416435750272:0@lo:700: 00000040:00080000:2.0:1787582942.773000:0:8749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787582942.775479:0:8750:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787582942.775486:0:8750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787582942.776035:0:8749:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787582942.776048:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787582942.776103:0:8749:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787582942.776127:0:8749:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b5fe6 00000100:00080000:3.0:1787582942.776137:0:8749:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787582942.776143:0:8749:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90936d8a3800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787582942.776177:0:8749:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909245895500 x1874416435751680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787582942.776210:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435751680:0@lo:8: 00000100:00100000:3.0:1787582942.776289:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.776354:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435751680 00000100:00100000:3.0:1787582942.776361:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435751680 00000100:00100000:3.0:1787582942.776403:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582942.776410:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1874416435751680:12345-0@lo:8: 00010000:00080000:3.0:1787582942.776446:0:8445:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:3.0:1787582942.776471:0:8445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b5fed 00002000:00100000:3.0:1787582942.776484:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90936f0b3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787582942.776488:0:8445:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787582942.776491:0:8445:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787582942.776567:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787582942.776586:0:8445:0:(import.c:65:import_set_state_nolock()) ffff90936f0b4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787582942.776626:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1874416435751680:12345-0@lo:8: Request processed in 215us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582942.776650:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787582942.776685:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245895500 x1874416435751680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787582952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582942.776696:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787582942.776708:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787582942.776714:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787582942.776718:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787582942.776721:0:3652:0:(import.c:65:import_set_state_nolock()) ffff90936d8a3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787582942.776730:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787582942.776735:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435751680:0@lo:8: 00000100:00080000:3.0:1787582942.776751:0:8749:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787582942.776812:0:8749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582942.776816:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582942.776818:0:8749:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787582942.776821:0:8749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582942.776824:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582942.776826:0:8749:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787582942.776828:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787582942.776830:0:8749:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787582942.776870:0:8749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8749:1874416435751808:0@lo:502: 00000100:00100000:3.0:1787582942.776909:0:8749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.776931:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435751808 00000100:00100000:3.0:1787582942.776934:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435751808 00000100:00100000:3.0:1787582942.776957:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787582942.776963:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+20:8749:x1874416435751808:12345-0@lo:502: 00000100:00100000:3.0:1787582942.777042:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+20:8749:x1874416435751808:12345-0@lo:502: Request processed in 78us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582942.777048:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787582942.777087:0:8749:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582942.777097:0:8749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:8749:1874416435751808:0@lo:502: 00000020:01000000:3.0:1787582942.777113:0:8749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582942.777116:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582942.777122:0:8749:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787582942.777125:0:8749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1787582942.777166:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787582942.777187:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787582942.777195:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5fd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.777205:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5fd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582942.777214:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787582942.777217:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff909343e199b8 from 1 10000000:01000000:3.0:1787582942.777220:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787582942.777240:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.777248:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.777257:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582942.777267:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435751936:0@lo:101: 00000100:00100000:3.0:1787582942.777290:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.777302:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582942.777313:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435751936 00000100:00100000:3.0:1787582942.777316:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435751936 00000100:00100000:3.0:1787582942.777335:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787582942.777340:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435751936:12345-0@lo:101: 00010000:00010000:3.0:1787582942.777348:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582942.777363:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909341481c00/0x19a47956376b5ffb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b5ff4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.777382:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909341481c00/0x19a47956376b5ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b5ff4 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.777392:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909341481c00/0x19a47956376b5ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5ff4 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.777400:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481c00, rc 0) 00000100:00100000:3.0:1787582942.777424:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435751936:12345-0@lo:101: Request processed in 84us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582942.777429:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787582942.777453:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435751936:0@lo:101: 00010000:00010000:3.0:1787582942.777463:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5ffb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.777472:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5ffb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582942.777508:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435752064:0@lo:501: 00000100:00100000:3.0:1787582942.777527:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.777537:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582942.777546:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435752064 00000100:00100000:3.0:1787582942.777549:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435752064 00000100:00100000:3.0:1787582942.777565:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787582942.777570:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435752064:12345-0@lo:501: 00000100:00100000:3.0:1787582942.777622:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435752064:12345-0@lo:501: Request processed in 52us (94us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787582942.777649:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787582942.777677:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435752064:0@lo:501: 10000000:01000000:3.0:1787582942.777693:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787582942.777697:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5ffb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582942.777705:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5ffb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787582942.777859:0:8750:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787582942.777912:0:8750:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 249931066232ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787582942.777918:0:8750:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787582942.782031:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787582942.791129:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787582942.791151:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435752192:0@lo:13: 00000100:00100000:2.0:1787582942.791217:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787582942.791253:0:8751:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787582942.791275:0:8751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245891f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1874416435752320:0@lo:7: 00000100:00100000:2.0:1787582942.791300:0:8751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582942.791332:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435752320 00000100:00100000:2.0:1787582942.791338:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435752320 00000100:00100000:2.0:1787582942.791454:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787582942.791464:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8751:x1874416435752320:12345-0@lo:7: 00000100:00100000:0.0:1787582942.796072:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435752192 00000100:00100000:0.0:1787582942.796086:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435752192 00000100:00100000:0.0:1787582942.796146:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787582942.796157:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1874416435752192:12345-0@lo:13: 00002000:00000024:0.0:1787582942.796186:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923812352 avail 3692290048 00000100:00100000:0.0:1787582942.796279:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1874416435752192:12345-0@lo:13: Request processed in 123us (5061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582942.796286:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787582942.796308:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787582942.796371:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245893800 x1874416435752192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582942.796404:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435752192:0@lo:13: 00000100:00100000:3.0:1787582942.798899:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435752448:0@lo:13: 00000100:00100000:3.0:1787582942.799045:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.799120:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435752448 00000100:00100000:3.0:1787582942.799127:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435752448 00000100:00100000:3.0:1787582942.799170:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582942.799178:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435752448:12345-0@lo:13: 00002000:00000024:3.0:1787582942.799198:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923812352 avail 3692290048 00000100:00100000:3.0:1787582942.799240:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435752448:12345-0@lo:13: Request processed in 62us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582942.799247:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787582942.799284:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245895500 x1874416435752448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582942.799306:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435752448:0@lo:13: 00000004:00080000:3.0:1787582942.799324:0:8747:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787582942.799345:0:8747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1874416435752576:0@lo:7: 00000100:00100000:3.0:1787582942.799368:0:8747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.799731:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787582942.799740:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:2.0:1787582942.800526:0:8444:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787582942.800533:0:8444:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787582942.800581:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8751:x1874416435752320:12345-0@lo:7: Request processed in 9117us (9278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582942.800590:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787582942.800608:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435752576 00000100:00100000:2.0:1787582942.800612:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435752576 00000100:00100000:2.0:1787582942.800664:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582942.800671:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8747:x1874416435752576:12345-0@lo:7: 00000100:00100000:0.0:1787582942.807194:0:8751:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736c1a80 going to sleep for 11 seconds 00010000:00080000:0.0:1787582942.807236:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245891f80 x1874416435752320/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787582958 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582942.807251:0:8751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245891f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1874416435752320:0@lo:7: 00000004:00080000:0.0:1787582942.807265:0:8751:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787582942.807304:0:8751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1874416435752704:0@lo:5: 00000100:00100000:0.0:1787582942.807358:0:8751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.807408:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787582942.807418:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435752704 00000100:00100000:0.0:1787582942.807423:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435752704 00000100:00100000:0.0:1787582942.807465:0:8751:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465f5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787582942.807745:0:8747:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582942.808085:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787582942.808095:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8751:x1874416435752704:12345-0@lo:5: 00002000:00080000:0.0:1787582942.808123:0:8752:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787582942.808127:0:8752:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00002000:00080000:2.0:1787582942.810703:0:8444:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787582942.810712:0:8444:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787582942.813868:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8747:x1874416435752576:12345-0@lo:7: Request processed in 13169us (14470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582942.813883:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000001:00080000:1.0:1787582942.814891:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787582942.814907:0:8437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1787582942.822065:0:8747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245895500 x1874416435752576/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787582958 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582942.822086:0:8747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1874416435752576:0@lo:7: 00000004:00080000:3.0:1787582942.822101:0:8747:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787582942.822141:0:8747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1874416435752832:0@lo:5: 00000100:00100000:3.0:1787582942.822194:0:8747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.822238:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435752832 00000100:00100000:3.0:1787582942.822244:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435752832 00000100:00100000:3.0:1787582942.822287:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582942.822296:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8747:x1874416435752832:12345-0@lo:5: 00002000:00080000:3.0:1787582942.822320:0:8445:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787582942.822347:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8747:x1874416435752832:12345-0@lo:5: Request processed in 53us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582942.822353:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582942.822395:0:8747:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00fb40 going to sleep for 11 seconds 00010000:00080000:3.0:1787582942.822408:0:8747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245895500 x1874416435752832/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582958 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582942.822418:0:8747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1874416435752832:0@lo:5: 00000004:00080000:3.0:1787582942.822426:0:8747:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787582942.822447:0:8747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1874416435752960:0@lo:5: 00000100:00100000:3.0:1787582942.822469:0:8747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582942.822485:0:8747:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787582942.822498:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435752960 00000100:00100000:3.0:1787582942.822501:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435752960 00000100:00100000:3.0:1787582942.822536:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787582942.822543:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8747:x1874416435752960:12345-0@lo:5: 00002000:00080000:3.0:1787582942.822566:0:8445:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787582942.825529:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8751:x1874416435752704:12345-0@lo:5: Request processed in 17429us (18164us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787582942.825542:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787582942.826155:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90924667f100 x1874416435752704/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582958 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582942.826167:0:8751:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787582942.826173:0:8751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1874416435752704:0@lo:5: 00000004:00080000:0.0:1787582942.826186:0:8751:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787582942.826236:0:8751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1874416435753088:0@lo:700: 00000100:00100000:0.0:1787582942.826281:0:8751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.826325:0:8751:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465f5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582942.826724:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435753088 00000100:00100000:2.0:1787582942.826731:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435753088 00000100:00100000:2.0:1787582942.826836:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787582942.826862:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8751:x1874416435753088:12345-0@lo:700: 00010000:00080000:0.0:1787582942.830090:0:8747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245895500 x1874416435752960/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582958 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582942.830111:0:8747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1874416435752960:0@lo:5: 00000004:00080000:0.0:1787582942.830125:0:8747:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1787582942.830168:0:8747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8747:1874416435753216:0@lo:900: 00000100:00100000:0.0:1787582942.830210:0:8747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582942.830238:0:8747:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787582942.831866:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8747:x1874416435752960:12345-0@lo:5: Request processed in 7213us (7285us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787582942.831881:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787582942.834555:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435753216 00000100:00100000:0.0:1787582942.834568:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435753216 00000100:00100000:0.0:1787582942.834626:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582942.835054:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8747:x1874416435753216:12345-0@lo:900: 00000100:00100000:0.0:1787582942.835145:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8747:x1874416435753216:12345-0@lo:900: Request processed in 96us (4935us total) trans 0 rc 0/0 00000001:00080000:2.0:1787582942.840292:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:2.0:1787582942.840430:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8751:x1874416435753088:12345-0@lo:700: Request processed in 13581us (14143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582942.840442:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582942.842740:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787582942.842985:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90924667f100 x1874416435753088/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787582958 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582942.843002:0:8751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1874416435753088:0@lo:700: 00010000:00080000:2.0:1787582942.843137:0:8747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90924667f480 x1874416435753216/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787582958 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582942.843148:0:8747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8747:1874416435753216:0@lo:900: 00000004:02000040:2.0:1787582942.844472:0:8751:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1787582942.858099:0:8751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1874416435753344:0@lo:5: 00000100:00100000:2.0:1787582942.858168:0:8751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582942.858270:0:8751:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736c1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787582942.862021:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435753344 00000100:00100000:3.0:1787582942.862034:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435753344 00000100:00100000:3.0:1787582942.865011:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787582942.865024:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8751:x1874416435753344:12345-0@lo:5: 00002000:00080000:3.0:1787582942.870723:0:8442:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787582942.870746:0:8442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1787582942.872154:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8751:x1874416435753344:12345-0@lo:5: Request processed in 7127us (13980us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787582942.872165:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787582942.872220:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245891880 x1874416435753344/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582958 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582942.872238:0:8751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1874416435753344:0@lo:5: 00000004:00080000:3.0:1787582942.872252:0:8751:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1787582943.567234:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787582944.149617:0:8820:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787582944.207601:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582944.207639:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435753472:0@lo:41: 00000100:00100000:1.0:1787582944.207712:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582944.207832:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435753472 00000100:00100000:2.0:1787582944.207840:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435753472 00000100:00100000:2.0:1787582944.207917:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787582944.207926:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435753472:12345-0@lo:41: 00000004:00000024:2.0:1787582944.207969:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787582944.208019:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435753472:12345-0@lo:41: Request processed in 93us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582944.208026:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787582944.208071:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435753472:0@lo:41: 00010000:00010000:2.0:1787582944.593237:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787582945.108195:0:8872:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787582945.108437:0:8872:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787582945.616167:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787582946.070533:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1787582946.638376:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582947.281253:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582947.281278:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435753600:0@lo:41: 00000100:00100000:1.0:1787582947.281339:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582947.281398:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435753600 00000100:00100000:1.0:1787582947.281405:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435753600 00000100:00100000:1.0:1787582947.281445:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787582947.281454:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435753600:12345-0@lo:41: 00000004:00000024:1.0:1787582947.281484:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787582947.281522:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435753600:12345-0@lo:41: Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582947.281528:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787582947.281568:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435753600:0@lo:41: 00010000:00010000:2.0:1787582947.668252:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582947.798308:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435753984:0@lo:400: 00000100:00100000:3.0:1787582947.798367:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435753856:0@lo:400: 00000100:00100000:1.0:1787582947.798380:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582947.798574:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582947.798701:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435754368:0@lo:400: 00000100:00100000:3.0:1787582947.798725:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582947.798762:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787582947.798768:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435753728:0@lo:400: 00000100:00100000:3.0:1787582947.798794:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582947.798812:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435754240:0@lo:400: 00000100:00100000:3.0:1787582947.798830:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582947.798872:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435754112:0@lo:400: 00000100:00100000:1.0:1787582947.799666:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435754496:0@lo:400: 00000100:00100000:1.0:1787582947.799725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582947.799779:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435753984 00000100:00100000:1.0:1787582947.799786:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435753984 00000100:00100000:1.0:1787582947.799821:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435753856 00000100:00100000:1.0:1787582947.799824:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435753856 00000100:00100000:1.0:1787582947.799835:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435754368 00000100:00100000:1.0:1787582947.799838:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435754368 00000100:00100000:1.0:1787582947.799873:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435754240 00000100:00100000:1.0:1787582947.799877:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435754240 00000100:00100000:1.0:1787582947.799893:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787582947.799901:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435753984:12345-0@lo:400: 00000100:00100000:1.0:1787582947.799950:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435753984:12345-0@lo:400: Request processed in 49us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582947.799957:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787582947.799973:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787582947.799978:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435753856:12345-0@lo:400: 00000100:00100000:1.0:1787582947.800011:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435753856:12345-0@lo:400: Request processed in 33us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582947.800016:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787582947.800027:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787582947.800033:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435754368:12345-0@lo:400: 00000100:00100000:1.0:1787582947.800061:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435754368:12345-0@lo:400: Request processed in 28us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582947.800067:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787582947.800078:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787582947.800085:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435754240:12345-0@lo:400: 00000100:00100000:1.0:1787582947.800112:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435754240:12345-0@lo:400: Request processed in 28us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582947.800125:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787582947.800161:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245892d80 x1874416435753984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582947.800174:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435753984:0@lo:400: 00000100:00100000:3.0:1787582947.800248:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582947.800283:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435754624:0@lo:400: 00000100:00100000:3.0:1787582947.800307:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582947.800363:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435753728 00000100:00100000:3.0:1787582947.800367:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435753728 00000100:00100000:3.0:1787582947.800399:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787582947.800407:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:3656:x1874416435753728:12345-0@lo:400: 00000100:00100000:3.0:1787582947.800444:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:3656:x1874416435753728:12345-0@lo:400: Request processed in 38us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582947.800451:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787582947.800495:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435753728:0@lo:400: 00010000:00080000:3.0:1787582947.800509:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245890000 x1874416435754240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582947.800519:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435754240:0@lo:400: 00010000:00080000:3.0:1787582947.800529:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245893b80 x1874416435753856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582947.800538:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435753856:0@lo:400: 00010000:00080000:3.0:1787582947.800550:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245891f80 x1874416435754368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582947.800573:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435754368:0@lo:400: 00000100:00100000:3.0:1787582947.800626:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435754112 00000100:00100000:3.0:1787582947.800629:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435754112 00000100:00100000:3.0:1787582947.800659:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787582947.800665:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435754112:12345-0@lo:400: 00000100:00080000:1.0:1787582947.800677:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787582947.800683:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787582947.800719:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435754112:12345-0@lo:400: Request processed in 53us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582947.800726:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787582947.800749:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435754496 00000100:00100000:3.0:1787582947.800752:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435754496 00000100:00100000:3.0:1787582947.800783:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435754624 00000100:00100000:3.0:1787582947.800786:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435754624 00000100:00100000:3.0:1787582947.800808:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582947.800816:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435754496:12345-0@lo:400: 00000100:00100000:1.0:1787582947.800821:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582947.800833:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435754624:12345-0@lo:400: 00000100:00100000:1.0:1787582947.800895:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435754624:12345-0@lo:400: Request processed in 65us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582947.800902:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787582947.800941:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582947.801032:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435754496:12345-0@lo:400: Request processed in 215us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582947.801039:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582947.801068:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435754112:0@lo:400: 00010000:00080000:3.0:1787582947.801080:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909377f0c380 x1874416435754624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582947.801087:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1787582947.801098:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435754624:0@lo:400: 00010000:00080000:1.0:1787582947.801398:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245893800 x1874416435754496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582947.801407:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787582947.801416:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435754496:0@lo:400: 00000020:00000004:1.0:1787582947.940305:0:8973:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787582947.940530:0:8973:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787582948.302254:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435754752:0@lo:13: 00000100:00100000:1.0:1787582948.302330:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582948.302477:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435754880:0@lo:13: 00000100:00100000:3.0:1787582948.302506:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582948.302552:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435754752 00000100:00100000:3.0:1787582948.302574:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435754752 00000100:00100000:3.0:1787582948.302617:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435754880 00000100:00100000:3.0:1787582948.302620:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435754880 00000100:00100000:3.0:1787582948.302634:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582948.302643:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435754752:12345-0@lo:13: 00002000:00000024:3.0:1787582948.302671:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787582948.306592:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435754752:12345-0@lo:13: Request processed in 3939us (4251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582948.306616:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582948.306648:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787582948.306661:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435754880:12345-0@lo:13: 00002000:00000024:3.0:1787582948.306684:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787582948.306995:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435754880:12345-0@lo:13: Request processed in 338us (4488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582948.307003:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787582948.309622:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245895880 x1874416435754752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582948.309652:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435754752:0@lo:13: 00010000:00080000:2.0:1787582948.313546:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909377f0ca80 x1874416435754880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582948.313574:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435754880:0@lo:13: 00010000:00010000:0.0:1787582948.686639:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787582948.884375:0:9022:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787582948.884389:0:9022:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1787582949.326806:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435755008:0@lo:41: 00000100:00100000:1.0:1787582949.327052:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582949.327478:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435755008 00000100:00100000:0.0:1787582949.327488:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435755008 00000100:00100000:0.0:1787582949.327534:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787582949.327543:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435755008:12345-0@lo:41: 00000004:00000024:0.0:1787582949.327574:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787582949.327639:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435755008:12345-0@lo:41: Request processed in 96us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582949.327646:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787582949.327748:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435755008:0@lo:41: 00010000:00010000:2.0:1787582949.710998:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582950.733999:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582951.758758:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582952.398287:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435755136:0@lo:41: 00000100:00100000:2.0:1787582952.398362:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582952.398630:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435755136 00000100:00100000:1.0:1787582952.398639:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435755136 00000100:00100000:1.0:1787582952.398700:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787582952.398712:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435755136:12345-0@lo:41: 00000004:00000024:1.0:1787582952.398754:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787582952.398829:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435755136:12345-0@lo:41: Request processed in 118us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582952.398837:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787582952.399028:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435755136:0@lo:41: 00010000:00010000:1.0:1787582952.786768:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582952.911598:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435755392:0@lo:400: 00000100:00100000:0.0:1787582952.911665:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582952.911733:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435755904:0@lo:400: 00000100:00100000:0.0:1787582952.911755:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582952.911795:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787582952.911800:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435755264:0@lo:400: 00000100:00100000:0.0:1787582952.911827:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582952.911985:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435755776:0@lo:400: 00000100:00100000:0.0:1787582952.912012:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582952.912031:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435756288:0@lo:400: 00000100:00100000:0.0:1787582952.912052:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582952.912075:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435755520:0@lo:400: 00000100:00100000:0.0:1787582952.912097:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582952.912112:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435756032:0@lo:400: 00000100:00100000:0.0:1787582952.912130:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582952.912145:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787582952.912150:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435755648:0@lo:400: 00000100:00100000:0.0:1787582952.912181:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582952.912210:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435756160:0@lo:400: 00000100:00100000:0.0:1787582952.912234:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582952.912268:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435755776 00000100:00100000:0.0:1787582952.912275:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435755776 00000100:00100000:0.0:1787582952.912308:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435755520 00000100:00100000:0.0:1787582952.912310:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435755520 00000100:00100000:0.0:1787582952.912338:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787582952.912346:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435755776:12345-0@lo:400: 00000100:00100000:0.0:1787582952.912402:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435755776:12345-0@lo:400: Request processed in 56us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582952.912409:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787582952.912426:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787582952.912432:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435755520:12345-0@lo:400: 00000100:00100000:0.0:1787582952.912464:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435755520:12345-0@lo:400: Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582952.912470:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787582952.912503:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435755520:0@lo:400: 00000100:00100000:0.0:1787582952.912530:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435755776:0@lo:400: 00000100:00100000:0.0:1787582952.912563:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435756288 00000100:00100000:0.0:1787582952.912579:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435756288 00000100:00100000:0.0:1787582952.912606:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435756160 00000100:00100000:0.0:1787582952.912609:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435756160 00000100:00100000:0.0:1787582952.912626:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582952.912631:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435756288:12345-0@lo:400: 00000100:00100000:0.0:1787582952.912664:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435756288:12345-0@lo:400: Request processed in 32us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582952.912670:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582952.912680:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787582952.912686:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435756160:12345-0@lo:400: 00000100:00100000:0.0:1787582952.912712:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435756160:12345-0@lo:400: Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582952.912717:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787582952.912737:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435755392 00000100:00100000:0.0:1787582952.912740:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435755392 00000100:00100000:0.0:1787582952.912762:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435755904 00000100:00100000:0.0:1787582952.912765:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435755904 00000100:00100000:0.0:1787582952.912777:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435756032 00000100:00100000:0.0:1787582952.914120:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435756032 00000100:00100000:0.0:1787582952.914157:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435755648 00000100:00100000:0.0:1787582952.914160:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435755648 00000100:00100000:0.0:1787582952.914176:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787582952.914183:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435755392:12345-0@lo:400: 00000100:00100000:1.0:1787582952.914358:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787582952.914473:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435755904:12345-0@lo:400: 00000100:00100000:1.0:1787582952.914538:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435755904:12345-0@lo:400: Request processed in 171us (2781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582952.914544:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787582952.914562:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787582952.914581:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435756032:12345-0@lo:400: 00000100:00100000:1.0:1787582952.914609:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435756032:12345-0@lo:400: Request processed in 30us (2478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582952.914615:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787582952.914626:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787582952.914632:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435755648:12345-0@lo:400: 00000100:00100000:0.0:1787582952.914716:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435755392:12345-0@lo:400: Request processed in 531us (3049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582952.914723:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787582952.914765:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90924667dc00 x1874416435756160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582952.914948:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435755648:12345-0@lo:400: Request processed in 316us (2766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582952.915022:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787582952.915060:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435756160:0@lo:400: 00000100:00080000:1.0:1787582952.915062:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787582952.915068:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787582952.915073:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787582952.915084:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90924667d880 x1874416435756032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582952.915096:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435756032:0@lo:400: 00010000:00080000:0.0:1787582952.915121:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90924667e680 x1874416435755648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582952.915131:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435755648:0@lo:400: 00010000:00080000:0.0:1787582952.915160:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90924667f800 x1874416435756288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582952.915170:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435756288:0@lo:400: 00010000:00080000:0.0:1787582952.915181:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90924667d180 x1874416435755392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582952.915190:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435755392:0@lo:400: 00010000:00080000:0.0:1787582952.915223:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90924667ce00 x1874416435755904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582952.915233:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435755904:0@lo:400: 00000100:00100000:3.0:1787582952.915876:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435755264 00000100:00100000:3.0:1787582952.915884:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435755264 00000100:00100000:3.0:1787582952.915926:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787582952.915934:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:3656:x1874416435755264:12345-0@lo:400: 00000100:00100000:3.0:1787582952.915992:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:3656:x1874416435755264:12345-0@lo:400: Request processed in 59us (4164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582952.915999:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787582952.916057:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435755264:0@lo:400: 00000100:00100000:3.0:1787582953.422022:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435756416:0@lo:13: 00000100:00100000:3.0:1787582953.422089:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582953.422149:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435756416 00000100:00100000:1.0:1787582953.422160:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435756416 00000100:00100000:1.0:1787582953.422218:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787582953.422227:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435756416:12345-0@lo:13: 00002000:00000024:1.0:1787582953.422255:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787582953.422321:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435756416:12345-0@lo:13: Request processed in 95us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582953.422328:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787582953.422362:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245894380 x1874416435756416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582953.422382:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435756416:0@lo:13: 00000100:00100000:3.0:1787582953.422783:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787582953.422794:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435756544:0@lo:13: 00000100:00100000:3.0:1787582953.422835:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582953.422896:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435756544 00000100:00100000:3.0:1787582953.422900:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435756544 00000100:00100000:3.0:1787582953.422940:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582953.422947:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435756544:12345-0@lo:13: 00002000:00000024:3.0:1787582953.422958:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787582953.422992:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435756544:12345-0@lo:13: Request processed in 45us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582953.422997:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787582953.423024:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909245894380 x1874416435756544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582953.423037:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435756544:0@lo:13: 00010000:00010000:1.0:1787582953.806776:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582954.446031:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435756672:0@lo:41: 00000100:00100000:2.0:1787582954.446122:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582954.446220:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435756672 00000100:00100000:2.0:1787582954.446623:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435756672 00000100:00100000:2.0:1787582954.446697:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787582954.446709:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435756672:12345-0@lo:41: 00000004:00000024:2.0:1787582954.446758:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787582954.446826:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435756672:12345-0@lo:41: Request processed in 118us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582954.446833:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787582954.446924:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435756672:0@lo:41: 00010000:00010000:3.0:1787582954.837396:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582955.856529:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582956.888182:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582957.521329:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435756800:0@lo:41: 00000100:00100000:3.0:1787582957.521407:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582957.521579:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435756800 00000100:00100000:1.0:1787582957.521588:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435756800 00000100:00100000:1.0:1787582957.521643:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787582957.521654:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435756800:12345-0@lo:41: 00000004:00000024:1.0:1787582957.521691:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787582957.521747:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435756800:12345-0@lo:41: Request processed in 96us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582957.521753:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787582957.521868:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435756800:0@lo:41: 00010000:00010000:3.0:1787582957.902924:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582958.030663:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435756928:0@lo:400: 00000100:00100000:0.0:1787582958.030729:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582958.030827:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435756928 00000100:00100000:1.0:1787582958.030834:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435756928 00000100:00100000:1.0:1787582958.030898:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787582958.030907:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:3656:x1874416435756928:12345-0@lo:400: 00000100:00100000:3.0:1787582958.031120:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435757312:0@lo:400: 00000100:00100000:3.0:1787582958.031155:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582958.031194:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435757312 00000100:00100000:3.0:1787582958.031197:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435757312 00000100:00100000:3.0:1787582958.031224:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787582958.031231:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435757312:12345-0@lo:400: 00000100:00100000:3.0:1787582958.031266:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435757312:12345-0@lo:400: Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582958.031284:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787582958.031322:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909351693800 x1874416435757312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582958.031335:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435757312:0@lo:400: 00000100:00100000:1.0:1787582958.031623:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:3656:x1874416435756928:12345-0@lo:400: Request processed in 716us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582958.031639:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787582958.031670:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435757056:0@lo:400: 00000100:00100000:1.0:1787582958.031696:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582958.031723:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582958.031728:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435757184:0@lo:400: 00000100:00100000:1.0:1787582958.031749:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582958.031773:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435757184 00000100:00100000:1.0:1787582958.031788:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435757184 00000100:00100000:1.0:1787582958.031816:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787582958.031822:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435757184:12345-0@lo:400: 00000100:00100000:1.0:1787582958.031875:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435757184:12345-0@lo:400: Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582958.031881:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787582958.031908:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435757184:0@lo:400: 00000100:00100000:3.0:1787582958.031977:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435757056 00000100:00100000:3.0:1787582958.031982:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435757056 00000100:00100000:3.0:1787582958.032025:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787582958.032033:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435757056:12345-0@lo:400: 00000100:00100000:3.0:1787582958.032070:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435757056:12345-0@lo:400: Request processed in 38us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582958.032076:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787582958.032101:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909351693100 x1874416435757056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582958.032111:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435757056:0@lo:400: 00000100:00100000:3.0:1787582958.032384:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582958.032703:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435756928:0@lo:400: 00000100:00100000:0.0:1787582958.032717:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787582958.032723:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435757824:0@lo:400: 00000100:00100000:0.0:1787582958.032750:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582958.032863:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435757568:0@lo:400: 00000100:00100000:1.0:1787582958.032887:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582958.032904:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582958.032908:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435757696:0@lo:400: 00000100:00100000:1.0:1787582958.032927:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582958.032983:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435757440:0@lo:400: 00000100:00100000:3.0:1787582958.033008:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582958.033128:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435757568 00000100:00100000:3.0:1787582958.033132:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435757568 00000100:00100000:3.0:1787582958.033167:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435757696 00000100:00100000:3.0:1787582958.033170:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435757696 00000100:00100000:3.0:1787582958.033189:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787582958.033196:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435757568:12345-0@lo:400: 00000100:00100000:3.0:1787582958.033244:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435757568:12345-0@lo:400: Request processed in 49us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582958.033250:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787582958.033276:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787582958.033283:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435757696:12345-0@lo:400: 00000100:00100000:3.0:1787582958.033311:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435757696:12345-0@lo:400: Request processed in 29us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582958.033316:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787582958.033331:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787582958.033335:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787582958.033359:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909351691880 x1874416435757696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582958.033369:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435757696:0@lo:400: 00010000:00080000:3.0:1787582958.033379:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909351691180 x1874416435757568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582958.033387:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435757568:0@lo:400: 00000100:00100000:0.0:1787582958.033703:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435757824 00000100:00100000:0.0:1787582958.033708:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435757824 00000100:00100000:0.0:1787582958.033751:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787582958.033758:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435757824:12345-0@lo:400: 00000100:00100000:0.0:1787582958.033810:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435757824:12345-0@lo:400: Request processed in 52us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582958.033816:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787582958.033859:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909351691f80 x1874416435757824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582958.033869:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435757824:0@lo:400: 00000100:00080000:3.0:1787582958.033963:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787582958.034162:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435757952:0@lo:400: 00000100:00100000:0.0:1787582958.034189:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582958.034326:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435757440 00000100:00100000:1.0:1787582958.034331:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435757440 00000100:00100000:1.0:1787582958.034362:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787582958.034368:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435757440:12345-0@lo:400: 00000100:00100000:1.0:1787582958.034547:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435757440:12345-0@lo:400: Request processed in 178us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582958.034553:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787582958.034661:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435757952 00000100:00100000:3.0:1787582958.034665:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435757952 00000100:00100000:3.0:1787582958.034701:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582958.034706:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435757952:12345-0@lo:400: 00000100:00100000:3.0:1787582958.034741:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435757952:12345-0@lo:400: Request processed in 35us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582958.034747:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787582958.034771:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909351691f80 x1874416435757952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582958.034791:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435757952:0@lo:400: 00000100:00080000:0.0:1787582958.034889:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582958.035128:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435757440:0@lo:400: 00000100:00100000:3.0:1787582958.543209:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435758208:0@lo:13: 00000100:00100000:3.0:1787582958.545233:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582958.545300:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787582958.545310:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435758080:0@lo:13: 00000100:00100000:2.0:1787582958.545324:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435758208 00000100:00100000:2.0:1787582958.545333:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435758208 00000100:00100000:3.0:1787582958.545334:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582958.545370:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435758080 00000100:00100000:3.0:1787582958.545375:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435758080 00000100:00100000:2.0:1787582958.545384:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787582958.545397:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435758208:12345-0@lo:13: 00002000:00000024:2.0:1787582958.545426:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582958.545487:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435758208:12345-0@lo:13: Request processed in 93us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582958.545494:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787582958.545511:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787582958.545518:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435758080:12345-0@lo:13: 00002000:00000024:2.0:1787582958.545545:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582958.545574:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435758080:12345-0@lo:13: Request processed in 56us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582958.545592:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787582958.545669:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909365f16680 x1874416435758080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582958.545690:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435758080:0@lo:13: 00010000:00080000:3.0:1787582958.545700:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909351693b80 x1874416435758208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582958.545710:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435758208:0@lo:13: 00010000:00010000:0.0:1787582958.925973:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582959.568298:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787582959.568328:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435758336:0@lo:41: 00000100:00100000:3.0:1787582959.568397:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.568594:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435758336 00000100:00100000:1.0:1787582959.568602:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435758336 00000100:00100000:1.0:1787582959.568654:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787582959.568665:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435758336:12345-0@lo:41: 00000004:00000024:1.0:1787582959.568698:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787582959.568766:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435758336:12345-0@lo:41: Request processed in 103us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.568772:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787582959.568830:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435758336:0@lo:41: 00000020:01000004:2.0:1787582959.617667:0:9521:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787582959.617671:0:9521:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787582959.617673:0:9521:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787582959.617795:0:9521:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90936db2f000 00000020:01000004:2.0:1787582959.617811:0:9521:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787582959.617824:0:9521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787582959.617837:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9092464ccd28) 00000020:00000080:2.0:1787582959.617876:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787582959.683594:0:9521:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787582959.683663:0:9521:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1787582959.714547:0:9521:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787582959.714795:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787582959.714824:0:9521:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787582959.714836:0:9521:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19a47956376b6009 00000020:01000004:0.0:1787582959.714867:0:9521:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787582959.714891:0:9521:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787582959.714895:0:9521:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787582959.714901:0:9521:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787582959.714937:0:9521:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787582959.714942:0:9521:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787582959.744506:0:9521:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787582959.744612:0:9521:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787582959.744616:0:9521:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787582959.744618:0:9521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787582959.744619:0:9521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787582959.744621:0:9521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787582959.744622:0:9521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787582959.744623:0:9521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787582959.744625:0:9521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787582959.744626:0:9521:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787582959.744628:0:9521:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787582959.744629:0:9521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787582959.744631:0:9521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787582959.744635:0:9521:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787582959.744637:0:9521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787582959.744638:0:9521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787582959.744640:0:9521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787582959.744641:0:9521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787582959.744642:0:9521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787582959.744643:0:9521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787582959.744644:0:9521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787582959.744645:0:9521:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787582959.744646:0:9521:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787582959.744647:0:9521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787582959.744648:0:9521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787582959.744675:0:9521:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787582959.744694:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435758464:0@lo:253: 00000100:00100000:0.0:1787582959.745031:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582959.745131:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582959.745179:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435758464 00000100:00100000:3.0:1787582959.745186:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435758464 00000100:00100000:3.0:1787582959.745338:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787582959.745348:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093749e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:9521:x1874416435758464:12345-0@lo:253: 20000000:01000000:3.0:1787582959.745385:0:6522:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787582959.745389:0:6522:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787582959.745395:0:6522:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787582959.745399:0:6522:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787582959.745694:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582959.748295:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1787582959.748335:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787582959.748376:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1787582959.748385:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787582959.748399:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1787582959.748416:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1787582959.748639:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1787582959.748658:0:6522:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:2.0:1787582959.748660:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:2.0:1787582959.748675:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1787582959.748681:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787582959.748694:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1787582959.748700:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:2.0:1787582959.748711:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1787582959.748717:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787582959.748729:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1787582959.748757:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1787582959.748873:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1787582959.748887:0:6522:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:2.0:1787582959.748889:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:2.0:1787582959.748904:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1787582959.748909:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787582959.748935:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1787582959.748941:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:2.0:1787582959.748952:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1787582959.748956:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787582959.748968:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1787582959.748982:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1787582959.749471:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1787582959.749487:0:6522:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:2.0:1787582959.749489:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:2.0:1787582959.749504:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1787582959.749510:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787582959.749538:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1787582959.749546:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:2.0:1787582959.749559:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1787582959.749566:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787582959.749579:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1787582959.749594:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1787582959.749607:0:6522:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787582959.749610:0:6522:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787582959.749615:0:6522:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787582959.749659:0:6522:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787582959.749662:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787582959.750301:0:9527:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787582959.750327:0:9527:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787582959.750341:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1787582959.750598:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1787582959.750618:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1787582959.750631:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1787582959.750642:0:6522:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787582959.750645:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787582959.751510:0:9528:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1787582959.751553:0:9528:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1787582959.751568:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1787582959.751790:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1787582959.751824:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1787582959.751838:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1787582959.751873:0:6522:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787582959.751875:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787582959.752352:0:9529:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1787582959.752381:0:9529:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1787582959.752392:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787582959.752599:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787582959.752621:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1787582959.752636:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1787582959.752646:0:6522:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787582959.752648:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787582959.753103:0:9530:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1787582959.753123:0:9530:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1787582959.753136:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1787582959.753337:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1787582959.753357:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1787582959.753372:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1787582959.753381:0:6522:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787582959.753383:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787582959.753694:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1787582959.754394:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1787582959.754418:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1787582959.754432:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:2.0:1787582959.754450:0:6522:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787582959.754470:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.754488:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367e400/0x19a47956376b5f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5eff expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.754495:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367ea00/0x19a47956376b5f30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5f29 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.754502:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909340031c00/0x19a47956376b5f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5f68 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.754509:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909340031200/0x19a47956376b5f8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5f84 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.754579:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367fa00/0x19a47956376b5fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5fa7 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.754590:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909341480000/0x19a47956376b5fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5fca expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.754597:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909341481c00/0x19a47956376b5ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5ff4 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.754617:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.754657:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909341481c00/0x19a47956376b5ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5ff4 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.754672:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909341481c00/0x19a47956376b5ffb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5ff4 expref: 21 pid: 6521 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.754687:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435758592:0@lo:104: 00000100:00100000:2.0:1787582959.755028:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582959.755085:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909341480000/0x19a47956376b5fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5fca expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.755094:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909341480000/0x19a47956376b5fd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5fca expref: 21 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.755102:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351692680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435758720:0@lo:104: 00000100:00100000:2.0:1787582959.755124:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582959.755185:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367fa00/0x19a47956376b5fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5fa7 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.755194:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90936367fa00/0x19a47956376b5fae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5fa7 expref: 21 pid: 6521 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.755203:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435758848:0@lo:104: 00000100:00100000:2.0:1787582959.755234:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582959.755400:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909340031200/0x19a47956376b5f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5f84 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.755418:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909340031200/0x19a47956376b5f8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5f84 expref: 21 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.755427:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435758976:0@lo:104: 00000100:00100000:2.0:1787582959.755449:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582959.755487:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435758592 00000100:00100000:3.0:1787582959.755495:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435758592 00000100:00100000:3.0:1787582959.755606:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435758720 00000100:00100000:3.0:1787582959.755610:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435758720 00000100:00100000:3.0:1787582959.755630:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435758848 00000100:00100000:3.0:1787582959.755632:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435758848 00000100:00100000:3.0:1787582959.755645:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787582959.755654:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:6522:x1874416435758592:12345-0@lo:104: 00010000:00010000:3.0:1787582959.755665:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5ffb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.755717:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787582959.755724:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:6522:x1874416435758592:12345-0@lo:104: Request processed in 71us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582959.755730:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787582959.755832:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582959.755839:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5ffb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.755906:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787582959.755910:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5ffb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.755919:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5ffb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582959.755926:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5ffb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582959.755932:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582959.755963:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5ffb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.755970:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582959.755994:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5ffb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.756001:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b5ff4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5ffb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.756013:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582959.756015:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582959.756017:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582959.756039:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435759104:0@lo:103: 00000100:00100000:1.0:1787582959.756071:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.756109:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435759104 00000100:00100000:1.0:1787582959.756113:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435759104 00010000:00010000:1.0:1787582959.756132:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909341481c00/0x19a47956376b5ffb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5ff4 expref: 22 pid: 6521 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582959.756151:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787582959.756158:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:3656:x1874416435759104:12345-0@lo:103: 00010000:00010000:1.0:1787582959.756168:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582959.756171:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909341481c00/0x19a47956376b5ffb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5ff4 expref: 22 pid: 6521 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.756180:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909341481c00/0x19a47956376b5ffb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5ff4 expref: 22 pid: 6521 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.756196:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582959.756311:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787582959.756320:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6522:x1874416435758720:12345-0@lo:104: 00010000:00010000:3.0:1787582959.756328:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5fd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.756362:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787582959.756367:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6522:x1874416435758720:12345-0@lo:104: Request processed in 50us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582959.756374:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787582959.756385:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787582959.756390:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6522:x1874416435758848:12345-0@lo:104: 00010000:00010000:3.0:1787582959.756397:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.756427:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787582959.756432:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6522:x1874416435758848:12345-0@lo:104: Request processed in 42us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582959.756448:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787582959.756463:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787582959.756467:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5fd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.756473:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1787582959.756476:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5fd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.756482:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5fd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582959.756489:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5fd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582959.756494:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582959.756512:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5fd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582959.756616:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:3656:x1874416435759104:12345-0@lo:103: Request processed in 457us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.756623:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787582959.756662:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435759104:0@lo:103: 00000100:00100000:1.0:1787582959.757305:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435758976 00000100:00100000:1.0:1787582959.757312:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435758976 00000100:00100000:1.0:1787582959.757337:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787582959.757343:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6522:x1874416435758976:12345-0@lo:104: 00010000:00010000:1.0:1787582959.757353:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5f8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757393:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787582959.757399:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6522:x1874416435758976:12345-0@lo:104: Request processed in 56us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.757405:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787582959.757420:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787582959.757424:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757431:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787582959.757434:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757441:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582959.757448:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582959.757453:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582959.757472:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757478:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582959.757502:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757509:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344dec600/0x19a47956376b5fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757532:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582959.757536:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5f8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757541:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340030800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787582959.757543:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5f8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757549:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5f8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582959.757554:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5f8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582959.757558:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582959.757570:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757575:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582959.757579:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757584:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909340030800/0x19a47956376b5f84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757592:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582959.757598:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582959.757600:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582959.757611:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435759360:0@lo:103: 00000100:00100000:1.0:1787582959.757637:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.757658:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582959.757663:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435759488:0@lo:103: 00000100:00100000:1.0:1787582959.757681:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.757708:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435759360 00000100:00100000:1.0:1787582959.757712:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435759360 00010000:00010000:1.0:1787582959.757728:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367fa00/0x19a47956376b5fae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5fa7 expref: 22 pid: 6521 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582959.757824:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435759488 00000100:00100000:1.0:1787582959.757828:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435759488 00010000:00010000:1.0:1787582959.757842:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909340031200/0x19a47956376b5f8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5f84 expref: 23 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582959.757878:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787582959.757884:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:3653:x1874416435759360:12345-0@lo:103: 00010000:00010000:1.0:1787582959.757894:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582959.757898:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367fa00/0x19a47956376b5fae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5fa7 expref: 23 pid: 6521 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757907:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367fa00/0x19a47956376b5fae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5fa7 expref: 23 pid: 6521 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757921:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582959.757946:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:3653:x1874416435759360:12345-0@lo:103: Request processed in 63us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.757952:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787582959.757972:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787582959.757978:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:3653:x1874416435759488:12345-0@lo:103: 00010000:00010000:1.0:1787582959.757986:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582959.757990:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909340031200/0x19a47956376b5f8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5f84 expref: 22 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.757997:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909340031200/0x19a47956376b5f8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5f84 expref: 22 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.758006:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582959.758027:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:3653:x1874416435759488:12345-0@lo:103: Request processed in 49us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.758032:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787582959.758069:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435759488:0@lo:103: 00000100:00100000:1.0:1787582959.758078:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435759360:0@lo:103: 00010000:00010000:3.0:1787582959.758154:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582959.758174:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5fd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.758180:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909341480200/0x19a47956376b5fca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5fd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.758191:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582959.758193:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582959.758195:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582959.758202:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582959.758316:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435759232:0@lo:103: 00000100:00100000:1.0:1787582959.758344:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582959.758435:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909340031c00/0x19a47956376b5f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5f68 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.758447:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909340031c00/0x19a47956376b5f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5f68 expref: 21 pid: 6522 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.758456:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435759616:0@lo:104: 00000100:00100000:2.0:1787582959.758503:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582959.758546:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367ea00/0x19a47956376b5f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5f29 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.758555:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90936367ea00/0x19a47956376b5f30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5f29 expref: 21 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.758563:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435759744:0@lo:104: 00000100:00100000:2.0:1787582959.758585:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582959.758602:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367e400/0x19a47956376b5f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5eff expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.758610:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90936367e400/0x19a47956376b5f06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5eff expref: 21 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.758619:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b60700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435759872:0@lo:104: 00000100:00100000:2.0:1787582959.758644:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936ef41300 going to sleep for 11 seconds 00010000:00010000:2.0:1787582959.758659:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909341481c00/0x19a47956376b5ffb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5ff4 expref: 21 pid: 6521 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.758670:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435758592:0@lo:104: 00000100:00100000:2.0:1787582959.758678:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351692680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435758720:0@lo:104: 00010000:00010000:2.0:1787582959.758686:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367fa00/0x19a47956376b5fae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5fa7 expref: 20 pid: 6521 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.758694:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435758848:0@lo:104: 00010000:00010000:2.0:1787582959.758702:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909340031200/0x19a47956376b5f8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5f84 expref: 19 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.758710:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435758976:0@lo:104: 00000100:00100000:1.0:1787582959.758830:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787582959.758883:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.758894:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435759616 00000100:00100000:1.0:1787582959.758899:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435759616 00000100:00100000:1.0:1787582959.758918:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435759744 00000100:00100000:1.0:1787582959.758921:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435759744 00000100:00100000:1.0:1787582959.758928:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435759872 00000100:00100000:1.0:1787582959.758931:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435759872 00000100:00100000:1.0:1787582959.758941:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787582959.758947:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:6522:x1874416435759616:12345-0@lo:104: 00010000:00010000:1.0:1787582959.758956:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5f6f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.759003:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787582959.759009:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:6522:x1874416435759616:12345-0@lo:104: Request processed in 62us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.759015:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787582959.759028:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787582959.759033:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909246446850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6522:x1874416435759744:12345-0@lo:104: 00010000:00010000:1.0:1787582959.759040:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5f30 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.759073:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787582959.759078:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909246446850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6522:x1874416435759744:12345-0@lo:104: Request processed in 45us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.759083:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787582959.759113:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787582959.759119:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6522:x1874416435759872:12345-0@lo:104: 00010000:00010000:1.0:1787582959.759126:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5f06 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.759155:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787582959.759160:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6522:x1874416435759872:12345-0@lo:104: Request processed in 42us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.759167:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787582959.759181:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787582959.759185:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5f6f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.759192:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344decc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787582959.759201:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5f6f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582959.759390:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435759232 00000100:00100000:3.0:1787582959.759395:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435759232 00010000:00010000:3.0:1787582959.759413:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909341480000/0x19a47956376b5fd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5fca expref: 19 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582959.759436:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787582959.759442:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373f50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3655:x1874416435759232:12345-0@lo:103: 00010000:00010000:3.0:1787582959.759451:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582959.759455:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909341480000/0x19a47956376b5fd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5fca expref: 19 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.759465:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909341480000/0x19a47956376b5fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5fca expref: 19 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.759479:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909341480000/0x19a47956376b5fd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5fca expref: 19 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.759491:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582959.759534:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373f50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+18:3655:x1874416435759232:12345-0@lo:103: Request processed in 92us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582959.759540:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787582959.759711:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5f6f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582959.759718:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5f6f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582959.759724:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582959.759894:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f6f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.759902:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582959.759915:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f6f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.759921:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b5f68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f6f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.759932:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787582959.759936:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5f30 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.759941:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344deda00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787582959.759943:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5f30 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.759949:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5f30 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582959.759967:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5f30 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582959.759972:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582959.759986:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f30 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.759991:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582959.760004:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f30 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.760010:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b5f29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f30 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.760020:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582959.760023:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5f06 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.760029:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344ded000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787582959.760032:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5f06 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.760038:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5f06 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582959.760044:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5f06 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582959.760049:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582959.760068:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f06 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.760075:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582959.760081:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f06 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.760087:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344ded000/0x19a47956376b5eff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f06 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.760099:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582959.760101:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582959.760103:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582959.760117:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435760256:0@lo:103: 00000100:00100000:1.0:1787582959.760147:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.760179:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582959.760185:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435760128:0@lo:103: 00000100:00100000:1.0:1787582959.760336:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582959.760468:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435760256 00000100:00100000:2.0:1787582959.760474:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435760256 00010000:00010000:2.0:1787582959.760495:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367e400/0x19a47956376b5f06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5eff expref: 18 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.760555:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435760128 00000100:00100000:2.0:1787582959.760558:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435760128 00010000:00010000:2.0:1787582959.760570:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367ea00/0x19a47956376b5f30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5f29 expref: 19 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.760582:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787582959.760588:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3654:x1874416435760256:12345-0@lo:103: 00010000:00010000:2.0:1787582959.760597:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582959.760601:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367e400/0x19a47956376b5f06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5eff expref: 19 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.760621:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367e400/0x19a47956376b5f06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5eff expref: 19 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.760634:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582959.760669:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3654:x1874416435760256:12345-0@lo:103: Request processed in 81us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582959.760675:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787582959.760689:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787582959.760695:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:3654:x1874416435760128:12345-0@lo:103: 00010000:00010000:2.0:1787582959.760702:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582959.760707:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367ea00/0x19a47956376b5f30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5f29 expref: 18 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.760714:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367ea00/0x19a47956376b5f30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5f29 expref: 18 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.760722:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582959.761000:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:3654:x1874416435760128:12345-0@lo:103: Request processed in 304us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582959.761007:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787582959.761099:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435760000:0@lo:103: 00000100:00100000:1.0:1787582959.761128:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.761281:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435759232:0@lo:103: 00010000:00010000:1.0:1787582959.761307:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582959.761321:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435760128:0@lo:103: 00000100:00100000:1.0:1787582959.761329:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435760256:0@lo:103: 00010000:00010000:1.0:1787582959.761340:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582959.761357:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435759616:0@lo:104: 00010000:00010000:1.0:1787582959.761367:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367ea00/0x19a47956376b5f30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5f29 expref: 17 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582959.761386:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435759744:0@lo:104: 00010000:00010000:1.0:1787582959.761399:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367e400/0x19a47956376b5f06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5eff expref: 16 pid: 6520 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582959.761406:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b60700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874416435759872:0@lo:104: 00010000:00010000:1.0:1787582959.761432:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.761491:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435760000 00000100:00100000:2.0:1787582959.761495:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435760000 00010000:00010000:2.0:1787582959.761513:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909340031c00/0x19a47956376b5f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5f68 expref: 16 pid: 6522 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582959.761632:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787582959.761640:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:3656:x1874416435760000:12345-0@lo:103: 00010000:00010000:2.0:1787582959.761650:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582959.761660:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909340031c00/0x19a47956376b5f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5f68 expref: 16 pid: 6522 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.761671:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909340031c00/0x19a47956376b5f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5f68 expref: 16 pid: 6522 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.761683:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909340031c00/0x19a47956376b5f6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5f68 expref: 16 pid: 6522 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.761696:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.761704:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.761717:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.761725:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.761731:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.761738:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.761755:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344ded200 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787582959.761760:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.761767:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.761792:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582959.761801:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582959.762015:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:3656:x1874416435760000:12345-0@lo:103: Request processed in 375us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582959.762022:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787582959.762072:0:6522:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.762081:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.762086:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344ded200/0x19a47956376b6010 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787582959.762099:0:6522:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787582959.764308:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093749e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+14:9521:x1874416435758464:12345-0@lo:253: Request processed in 18955us (19270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.764321:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787582959.764470:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435760000:0@lo:103: 00000100:00100000:1.0:1787582959.764636:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435758464:0@lo:253: 10000000:01000000:1.0:1787582959.764648:0:9521:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787582959.764652:0:9521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787582959.764653:0:9521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787582959.764655:0:9521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787582959.764656:0:9521:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787582959.764657:0:9521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787582959.764669:0:9521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787582959.764671:0:9521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787582959.764672:0:9521:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787582959.764674:0:9521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787582959.764675:0:9521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787582959.764695:0:9521:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90936db2f000 from lustre-OST0001 10000000:01000000:1.0:1787582959.764724:0:9521:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787582959.764727:0:9521:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787582959.764737:0:9521:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff909343e199b8 local copy 10000000:01000000:1.0:1787582959.764882:0:9521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787582959.764921:0:9521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.764930:0:9521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.764939:0:9521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582959.764956:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435760384:0@lo:101: 00000100:00100000:1.0:1787582959.764990:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.765009:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093485e2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582959.765070:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435760384 00000100:00100000:0.0:1787582959.765076:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435760384 00000100:00100000:0.0:1787582959.765120:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787582959.765129:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093749e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+14:9521:x1874416435760384:12345-0@lo:101: 00010000:00010000:0.0:1787582959.765141:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582959.765155:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90938216f800/0x19a47956376b601e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6017 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582959.765191:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90938216f800/0x19a47956376b601e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6017 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582959.765201:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90938216f800/0x19a47956376b601e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6017 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582959.765280:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90938216f800, rc 0) 00000100:00100000:0.0:1787582959.765314:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093749e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:9521:x1874416435760384:12345-0@lo:101: Request processed in 186us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582959.765319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787582959.765391:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435760384:0@lo:101: 00010000:00010000:1.0:1787582959.765404:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x19a47956376b601e expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.765413:0:9521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19a47956376b601e expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582959.765503:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435760512:0@lo:501: 00000100:00100000:1.0:1787582959.765708:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.765751:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093485e2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582959.766006:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435760512 00000100:00100000:0.0:1787582959.766012:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435760512 00000100:00100000:0.0:1787582959.766049:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787582959.766057:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909345379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:9521:x1874416435760512:12345-0@lo:501: 00000100:00100000:0.0:1787582959.766162:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909345379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:9521:x1874416435760512:12345-0@lo:501: Request processed in 105us (453us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787582959.766169:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787582959.766311:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435760512:0@lo:501: 10000000:01000000:3.0:1787582959.766325:0:9521:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787582959.766346:0:9521:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787582959.766350:0:9521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19a47956376b601e expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.766358:0:9521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19a47956376b601e expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.766376:0:9521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19a47956376b601e expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.766424:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787582959.766452:0:9521:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90936db2f000 10000000:01000000:3.0:1787582959.766457:0:9521:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787582959.766462:0:9521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787582959.766465:0:9521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787582959.766470:0:9521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787582959.766473:0:9521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787582959.766491:0:9521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.766499:0:9521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.766507:0:9521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582959.766587:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435760640:0@lo:101: 00000100:00100000:3.0:1787582959.766618:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582959.766646:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f130900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582959.766696:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435760640 00000100:00100000:0.0:1787582959.766700:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435760640 00000100:00100000:0.0:1787582959.766736:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787582959.766753:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934537a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:9521:x1874416435760640:12345-0@lo:101: 00010000:00010000:0.0:1787582959.766760:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582959.766770:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90938216e000/0x19a47956376b602c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6025 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582959.766785:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90938216e000/0x19a47956376b602c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6025 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582959.766946:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90938216e000/0x19a47956376b602c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6025 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582959.766955:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90938216e000, rc 0) 00000100:00100000:0.0:1787582959.766984:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934537a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435760640:12345-0@lo:101: Request processed in 242us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582959.766991:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787582959.767192:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435760640:0@lo:101: 00010000:00010000:3.0:1787582959.767203:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b602c expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.767221:0:9521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b602c expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582959.767299:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435760768:0@lo:501: 00000100:00100000:3.0:1787582959.767325:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582959.767342:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f130900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582959.767441:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435760768 00000100:00100000:0.0:1787582959.767445:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435760768 00000100:00100000:0.0:1787582959.767477:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787582959.767484:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937702bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435760768:12345-0@lo:501: 00000100:00100000:0.0:1787582959.767587:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937702bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435760768:12345-0@lo:501: Request processed in 103us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582959.767594:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:1.0:1787582959.767712:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582959.767720:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x19a47956376b601e expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.767728:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367ec00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787582959.767731:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x19a47956376b601e expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.767749:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x19a47956376b601e expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582959.767757:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x19a47956376b601e expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582959.767763:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582959.767782:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a47956376b601e expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.767789:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787582959.767947:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435760896:0@lo:103: 00000100:00100000:0.0:1787582959.767977:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582959.768017:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435760896 00000100:00100000:0.0:1787582959.768021:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435760896 00000100:00100000:0.0:1787582959.768050:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582959.768057:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+16:3655:x1874416435760896:12345-0@lo:103: 00010000:00010000:0.0:1787582959.768068:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582959.768081:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90938216f800/0x19a47956376b601e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b6017 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582959.768093:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582959.768120:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+15:3655:x1874416435760896:12345-0@lo:103: Request processed in 64us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582959.768136:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582959.768167:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435760896:0@lo:103: 00010000:00010000:1.0:1787582959.768237:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a47956376b601e expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.768244:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6017 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a47956376b601e expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.768255:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582959.768257:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582959.768258:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582959.768404:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435760768:0@lo:501: 00000100:00100000:3.0:1787582959.768431:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761024:0@lo:503: 00000100:00100000:3.0:1787582959.768471:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582959.768492:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f130900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582959.768540:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435761024 00000100:00100000:0.0:1787582959.768545:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435761024 00000100:00100000:0.0:1787582959.768574:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787582959.768582:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:9521:x1874416435761024:12345-0@lo:503: 00000100:00100000:0.0:1787582959.768673:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:9521:x1874416435761024:12345-0@lo:503: Request processed in 91us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582959.768679:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787582959.768942:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761024:0@lo:503: 00000040:00080000:3.0:1787582959.769230:0:9521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787582959.769305:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761152:0@lo:502: 00000100:00100000:3.0:1787582959.769338:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582959.769360:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f130900 going to sleep for 11 seconds 00000100:00100000:1.0:1787582959.769483:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435761152 00000100:00100000:1.0:1787582959.769487:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435761152 00000100:00100000:1.0:1787582959.769536:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787582959.769550:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:9521:x1874416435761152:12345-0@lo:502: 00000100:00100000:1.0:1787582959.769635:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:9521:x1874416435761152:12345-0@lo:502: Request processed in 86us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.769642:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787582959.769982:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761152:0@lo:502: 00000040:00080000:3.0:1787582959.770200:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787582959.770302:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787582959.770316:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787582959.770327:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787582959.770338:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787582959.770350:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787582959.770371:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761280:0@lo:502: 00000100:00100000:3.0:1787582959.770407:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582959.770437:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f130900 going to sleep for 11 seconds 00000100:00100000:1.0:1787582959.770479:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435761280 00000100:00100000:1.0:1787582959.770484:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435761280 00000100:00100000:1.0:1787582959.770515:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787582959.770615:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937702a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:9521:x1874416435761280:12345-0@lo:502: 00000100:00100000:1.0:1787582959.770696:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937702a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:9521:x1874416435761280:12345-0@lo:502: Request processed in 83us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582959.770751:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761280:0@lo:502: 00000040:00080000:3.0:1787582959.770787:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787582959.770800:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1787582959.771515:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787582959.771538:0:9532:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787582959.771545:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582959.771547:0:9532:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787582959.771553:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787582959.771567:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90924668b370) 00000020:00000080:0.0:1787582959.771589:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787582959.771596:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787582959.771690:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90936db2f000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787582959.771699:0:9532:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787582959.771706:0:9532:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19a47956376b603a 00000100:00100000:1.0:1787582959.773717:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00010000:1.0:1787582959.778135:0:9532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1787582959.778696:0:9532:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787582959.784090:0:9532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787582959.784724:0:9532:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787582959.791012:0:9532:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787582959.791194:0:9532:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787582959.799370:0:9532:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787582959.802436:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787582959.802452:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582959.802610:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582959.802613:0:9532:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787582959.802617:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582959.802622:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582959.802630:0:9532:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787582959.802634:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787582959.802636:0:9532:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787582959.802666:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582959.802670:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582959.802671:0:9532:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787582959.802674:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787582959.802971:0:9521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787582959.803001:0:9521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787582959.803022:0:9521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b602c expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.803034:0:9521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b602c expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582959.803043:0:9521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936db2f000 from 1 10000000:01000000:3.0:1787582959.803046:0:9521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787582959.803084:0:9521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.803092:0:9521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.803102:0:9521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582959.803125:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761408:0@lo:101: 00000100:00100000:3.0:1787582959.803189:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582959.803232:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435761408 00000100:00100000:3.0:1787582959.803239:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435761408 00000100:00100000:3.0:1787582959.803283:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787582959.803293:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+15:9521:x1874416435761408:12345-0@lo:101: 00010000:00010000:3.0:1787582959.803306:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582959.803316:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909341480200/0x19a47956376b6048 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6041 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.803349:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909341480200/0x19a47956376b6048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6041 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.803360:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909341480200/0x19a47956376b6048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6041 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.803367:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480200, rc 0) 00000100:00100000:3.0:1787582959.803398:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435761408:12345-0@lo:101: Request processed in 106us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582959.803404:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787582959.803448:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f130900 going to sleep for 11 seconds 00000100:00100000:3.0:1787582959.803468:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761408:0@lo:101: 00010000:00010000:3.0:1787582959.803481:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6048 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.803490:0:9521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b6048 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582959.804197:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761536:0@lo:501: 00000100:00100000:3.0:1787582959.805016:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582959.805142:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f130900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582959.805352:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435761536 00000100:00100000:0.0:1787582959.805359:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435761536 00000100:00100000:0.0:1787582959.805436:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787582959.805446:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435761536:12345-0@lo:501: 00000100:00100000:0.0:1787582959.805629:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435761536:12345-0@lo:501: Request processed in 184us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582959.805637:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787582959.805834:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761536:0@lo:501: 00000100:00100000:1.0:1787582959.805925:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761664:0@lo:503: 00000100:00100000:1.0:1787582959.805973:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.805993:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936eea6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787582959.806617:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435761664 00000100:00100000:0.0:1787582959.806624:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435761664 00000100:00100000:0.0:1787582959.806666:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787582959.806675:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435761664:12345-0@lo:503: 00000100:00100000:0.0:1787582959.806794:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435761664:12345-0@lo:503: Request processed in 120us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582959.806801:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787582959.806873:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761664:0@lo:503: 00000040:00080000:0.0:1787582959.807162:0:9521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787582959.807444:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761792:0@lo:502: 00000100:00100000:0.0:1787582959.807485:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.807612:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435761792 00000100:00100000:1.0:1787582959.807618:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435761792 00000100:00100000:0.0:1787582959.807736:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936ed1e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787582959.807832:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787582959.807841:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435761792:12345-0@lo:502: 00000100:00100000:1.0:1787582959.807967:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435761792:12345-0@lo:502: Request processed in 127us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.807982:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787582959.808067:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761792:0@lo:502: 00000040:00080000:0.0:1787582959.808349:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787582959.808378:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787582959.808400:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761920:0@lo:502: 00000100:00100000:0.0:1787582959.808438:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582959.809589:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435761920 00000100:00100000:2.0:1787582959.809599:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435761920 00000100:00100000:2.0:1787582959.809636:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787582959.809645:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435761920:12345-0@lo:502: 00000100:00100000:0.0:1787582959.809688:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344b7ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582959.810181:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435761920:12345-0@lo:502: Request processed in 535us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582959.810189:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787582959.811446:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435761920:0@lo:502: 00000040:00080000:3.0:1787582959.811660:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787582959.811675:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787582959.813341:0:9536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582959.813356:0:9536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582959.813359:0:9536:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787582959.813374:0:9536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90936db2f000 00000020:00000080:3.0:1787582959.813377:0:9536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787582959.813389:0:9536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582959.813392:0:9536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582959.813394:0:9536:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787582959.813397:0:9536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787582959.813919:0:9521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787582959.813952:0:9521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787582959.813970:0:9521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6048 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582959.813981:0:9521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6048 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582959.814036:0:9521:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787582959.814039:0:9521:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90936db2f000 10000000:01000000:0.0:1787582959.814043:0:9521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90936db2f000 10000000:01000000:0.0:1787582959.814047:0:9521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787582959.814053:0:9521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90936db2f000 from 1 10000000:01000000:0.0:1787582959.814056:0:9521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787582959.814109:0:9521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582959.814117:0:9521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582959.814128:0:9521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582959.814152:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435762048:0@lo:101: 00000100:00100000:0.0:1787582959.814962:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582959.815010:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344b7ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787582959.815102:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435762048 00000100:00100000:3.0:1787582959.815111:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435762048 00000100:00100000:3.0:1787582959.815159:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787582959.815168:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:9521:x1874416435762048:12345-0@lo:101: 00010000:00010000:3.0:1787582959.815182:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582959.815196:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909341481600/0x19a47956376b6056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b604f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.815361:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909341481600/0x19a47956376b6056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b604f expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.815373:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909341481600/0x19a47956376b6056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b604f expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.815382:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481600, rc 0) 00000100:00100000:3.0:1787582959.815435:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:9521:x1874416435762048:12345-0@lo:101: Request processed in 268us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582959.815442:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787582959.815593:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435762048:0@lo:101: 00010000:00010000:0.0:1787582959.815610:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6056 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582959.815633:0:9521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b6056 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582959.815736:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435762176:0@lo:501: 00000100:00100000:0.0:1787582959.816106:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582959.816138:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344b7ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582959.816185:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435762176 00000100:00100000:2.0:1787582959.816191:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435762176 00000100:00100000:2.0:1787582959.816269:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787582959.816279:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:9521:x1874416435762176:12345-0@lo:501: 00000100:00100000:2.0:1787582959.816413:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:9521:x1874416435762176:12345-0@lo:501: Request processed in 135us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582959.816420:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787582959.816639:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435762176:0@lo:501: 00000100:00100000:1.0:1787582959.816674:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435762304:0@lo:503: 00000100:00100000:1.0:1787582959.816720:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.817115:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936eea66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582959.817170:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435762304 00000100:00100000:0.0:1787582959.817176:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435762304 00000100:00100000:0.0:1787582959.817215:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787582959.817222:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:9521:x1874416435762304:12345-0@lo:503: 00000100:00100000:0.0:1787582959.817315:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:9521:x1874416435762304:12345-0@lo:503: Request processed in 93us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582959.817322:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787582959.817453:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435762304:0@lo:503: 00000040:00080000:1.0:1787582959.817733:0:9521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787582959.817823:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435762432:0@lo:502: 00000100:00100000:1.0:1787582959.817900:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.817923:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936eea66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582959.818168:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435762432 00000100:00100000:0.0:1787582959.818174:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435762432 00000100:00100000:0.0:1787582959.818198:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787582959.818213:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:9521:x1874416435762432:12345-0@lo:502: 00000100:00100000:0.0:1787582959.818309:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:9521:x1874416435762432:12345-0@lo:502: Request processed in 104us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582959.818315:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787582959.818448:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435762432:0@lo:502: 00000040:00080000:1.0:1787582959.818675:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787582959.818704:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787582959.818720:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787582959.818733:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787582959.818761:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787582959.818775:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787582959.818788:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787582959.818801:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787582959.818827:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787582959.818841:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787582959.818892:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787582959.818905:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787582959.818917:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787582959.818930:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787582959.818943:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787582959.818955:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787582959.818983:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787582959.818995:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787582959.819006:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787582959.819019:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787582959.819031:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787582959.819044:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787582959.819055:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787582959.819068:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787582959.819080:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787582959.819092:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787582959.819104:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787582959.819116:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787582959.819127:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787582959.819137:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787582959.819148:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787582959.819160:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787582959.819172:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787582959.819184:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787582959.819197:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787582959.820053:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787582959.820079:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1787582959.820094:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787582959.820106:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1787582959.820118:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1787582959.820130:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1787582959.820143:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1787582959.820175:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1787582959.820189:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1787582959.820295:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1787582959.820312:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1787582959.820358:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435762560:0@lo:502: 00000100:00100000:0.0:1787582959.820429:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582959.820474:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344b7c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787582959.820544:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435762560 00000100:00100000:1.0:1787582959.820551:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435762560 00000100:00100000:1.0:1787582959.820596:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787582959.820606:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:9521:x1874416435762560:12345-0@lo:502: 00000100:00100000:1.0:1787582959.820727:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:9521:x1874416435762560:12345-0@lo:502: Request processed in 122us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.820734:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787582959.821071:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435762560:0@lo:502: 00000040:00080000:0.0:1787582959.821129:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1787582959.821137:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1787582959.822297:0:9537:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787582959.822312:0:9537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90924668cd28) 00000020:00000080:0.0:1787582959.822333:0:9537:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1787582959.822401:0:9537:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90936db2f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787582959.822405:0:9537:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90936db2f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787582959.822408:0:9537:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90936db2f000 3 00010000:00080000:0.0:1787582959.822434:0:9537:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9092471b9000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1787582959.826085:0:9537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1787582959.826348:0:9537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787582959.826391:0:9537:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787582959.826402:0:9537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x19a47956376b6064 00000100:00080000:0.0:1787582959.826411:0:9537:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787582959.826416:0:9537:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9092471b9000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1787582959.826446:0:9537:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90936f15ca80 x1874416435762688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787582959.826582:0:9537:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787582959.826816:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435763200:0@lo:400: 00000100:00100000:1.0:1787582959.826900:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.826938:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787582959.826943:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435762816:0@lo:400: 00000100:00100000:1.0:1787582959.826972:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.826987:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435763328:0@lo:400: 00000100:00100000:1.0:1787582959.827001:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.827020:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435762944:0@lo:400: 00000100:00100000:1.0:1787582959.827039:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.827052:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435763456:0@lo:400: 00000100:00100000:1.0:1787582959.827069:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.827084:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787582959.827088:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435763072:0@lo:400: 00000100:00100000:1.0:1787582959.827105:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.827120:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435763584:0@lo:400: 00000100:00100000:1.0:1787582959.827135:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.827162:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435763200 00000100:00100000:1.0:1787582959.827169:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435763200 00000100:00100000:1.0:1787582959.827220:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435762816 00000100:00100000:1.0:1787582959.827223:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435762816 00000100:00100000:1.0:1787582959.827232:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435763328 00000100:00100000:1.0:1787582959.827234:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435763328 00000100:00100000:1.0:1787582959.827242:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435763072 00000100:00100000:1.0:1787582959.827243:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435763072 00000100:00100000:1.0:1787582959.827255:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787582959.827263:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435763200:12345-0@lo:400: 00000100:00100000:1.0:1787582959.827309:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435763200:12345-0@lo:400: Request processed in 47us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.827314:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787582959.827326:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787582959.827331:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435762816:12345-0@lo:400: 00000100:00100000:1.0:1787582959.827362:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435762816:12345-0@lo:400: Request processed in 31us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.827367:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787582959.827375:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787582959.827380:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435763328:12345-0@lo:400: 00000100:00100000:1.0:1787582959.827399:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435763328:12345-0@lo:400: Request processed in 20us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.827403:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787582959.827412:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787582959.827417:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435763072:12345-0@lo:400: 00000100:00100000:1.0:1787582959.827460:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435763072:12345-0@lo:400: Request processed in 43us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.827466:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787582959.827489:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435762944 00000100:00100000:1.0:1787582959.827492:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435762944 00000100:00100000:1.0:1787582959.827511:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787582959.827699:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435762944:12345-0@lo:400: 00000100:00100000:1.0:1787582959.827734:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435762944:12345-0@lo:400: Request processed in 217us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.827797:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787582959.827822:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435763456 00000100:00100000:1.0:1787582959.827825:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435763456 00000100:00100000:1.0:1787582959.827871:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435763584 00000100:00100000:1.0:1787582959.827874:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435763584 00000100:00100000:1.0:1787582959.827891:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582959.827897:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435763456:12345-0@lo:400: 00000100:00100000:1.0:1787582959.827927:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435763456:12345-0@lo:400: Request processed in 31us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.827947:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582959.827959:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787582959.827964:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435763584:12345-0@lo:400: 00000100:00100000:1.0:1787582959.827986:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435763584:12345-0@lo:400: Request processed in 24us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.827991:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787582959.828041:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90936f2b5c00 x1874416435763072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582959.828054:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435763072:0@lo:400: 00010000:00080000:1.0:1787582959.828064:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90936f2b6d80 x1874416435763584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582959.828072:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435763584:0@lo:400: 00000100:00100000:1.0:1787582959.828079:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435762944:0@lo:400: 00010000:00080000:1.0:1787582959.828087:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90936f2b4a80 x1874416435763456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582959.828094:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435763456:0@lo:400: 00010000:00080000:1.0:1787582959.828129:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90936f2b7b80 x1874416435762816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582959.828137:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435762816:0@lo:400: 00010000:00080000:1.0:1787582959.828146:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90936f2b6300 x1874416435763328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582959.828153:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435763328:0@lo:400: 00010000:00080000:1.0:1787582959.828172:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90936f2b5880 x1874416435763200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582959.828179:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435763200:0@lo:400: 00000100:00100000:3.0:1787582959.828449:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874416435762688:0@lo:38: 00000100:00100000:3.0:1787582959.828486:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1787582959.828926:0:9537:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787582959.828940:0:9537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff909246688000) 00000020:00000080:0.0:1787582959.828960:0:9537:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1787582959.829047:0:9537:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90936db2f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787582959.829050:0:9537:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90936db2f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787582959.829052:0:9537:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90936db2f000 3 00010000:00080000:0.0:1787582959.829076:0:9537:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9092471bf000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.111@tcp at head 00000100:00100000:1.0:1787582959.829630:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435762688 00000100:00100000:1.0:1787582959.829638:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435762688 00000100:00100000:1.0:1787582959.829672:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787582959.829679:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874416435762688:12345-0@lo:38: 00010000:00080000:1.0:1787582959.829700:0:6528:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:1.0:1787582959.829725:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x19a47956376b6072 00000004:00100000:1.0:1787582959.830285:0:6528:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787582959.830322:0:6528:0:(import.c:65:import_set_state_nolock()) ffff90936f232000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582959.830390:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874416435762688:12345-0@lo:38: Request processed in 710us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.830398:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787582959.830448:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90936f15ca80 x1874416435762688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787582969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582959.830458:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787582959.830470:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787582959.830477:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787582959.830481:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787582959.830483:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9092471b9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787582959.830489:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874416435762688:0@lo:38: 00000100:00100000:3.0:1787582959.830725:0:9538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9538:1874416435763712:0@lo:901: 00000100:00100000:3.0:1787582959.830772:0:9538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582959.830799:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435763712 00000100:00100000:3.0:1787582959.830819:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435763712 00000100:00100000:3.0:1787582959.830873:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582959.830880:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9538:x1874416435763712:12345-0@lo:901: 00000100:00100000:3.0:1787582959.831401:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9538:x1874416435763712:12345-0@lo:901: Request processed in 519us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582959.831408:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787582959.831430:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582959.831443:0:9538:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f130e40 going to sleep for 11 seconds 00010000:00080000:3.0:1787582959.831459:0:9538:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909377f0c380 x1874416435763712/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787582975 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582959.831469:0:9538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9538:1874416435763712:0@lo:901: 00010000:00010000:0.0:1787582959.838288:0:9537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1787582959.838503:0:9537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787582959.840960:0:9537:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787582959.840981:0:9537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x19a47956376b6079 00000100:00080000:0.0:1787582959.840993:0:9537:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787582959.841000:0:9537:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9092471bf000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1787582959.841042:0:9537:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90936f15d180 x1874416435763840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787582959.841067:0:9537:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787582959.842436:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874416435763840:0@lo:38: 00000100:00100000:1.0:1787582959.842531:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.842597:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435763840 00000100:00100000:1.0:1787582959.842614:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435763840 00000100:00100000:1.0:1787582959.842651:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582959.842660:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874416435763840:12345-0@lo:38: 00010000:00080000:1.0:1787582959.842687:0:6527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:1.0:1787582959.842722:0:6527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x19a47956376b6080 00000004:00100000:1.0:1787582959.842737:0:6527:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787582959.842769:0:6527:0:(import.c:65:import_set_state_nolock()) ffff90936f236000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582959.842823:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874416435763840:12345-0@lo:38: Request processed in 162us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.842829:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787582959.842891:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90936f15d180 x1874416435763840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787582969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582959.842901:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787582959.842910:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787582959.842918:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787582959.842922:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787582959.842924:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9092471bf000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787582959.842930:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874416435763840:0@lo:38: 00000040:00080000:0.0:1787582959.843482:0:9537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1787582959.844407:0:9521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1787582959.844445:0:9521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787582959.844467:0:9521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6056 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582959.844480:0:9521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6056 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787582959.845661:0:9521:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787582959.845665:0:9521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787582959.845666:0:9521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787582959.845667:0:9521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787582959.845669:0:9521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787582959.845671:0:9521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787582959.845672:0:9521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787582959.845674:0:9521:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787582959.845675:0:9521:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787582959.845685:0:9521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787582959.845686:0:9521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787582959.845691:0:9521:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787582959.845694:0:9521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787582959.845696:0:9521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787582959.845697:0:9521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787582959.845698:0:9521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787582959.845699:0:9521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787582959.845700:0:9521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787582959.845700:0:9521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787582959.845701:0:9521:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787582959.845702:0:9521:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787582959.845703:0:9521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787582959.845704:0:9521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787582959.845770:0:9521:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787582959.845790:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435763968:0@lo:253: 00000100:00100000:0.0:1787582959.845886:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582959.845931:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787582959.846131:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435763968 00000100:00100000:1.0:1787582959.846141:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435763968 00000100:00100000:1.0:1787582959.846190:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787582959.846199:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:9521:x1874416435763968:12345-0@lo:253: 20000000:01000000:1.0:1787582959.846353:0:6522:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787582959.846368:0:6522:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787582959.856350:0:6522:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787582959.856377:0:6522:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787582959.856681:0:6543:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787582959.856688:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787582959.856709:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.856727:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909340031600/0x19a47956376b5f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5f76 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.856736:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909341481800/0x19a47956376b5fc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5fbc expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.856752:0:6543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.856793:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909341481800/0x19a47956376b5fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5fbc expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.856817:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909341481800/0x19a47956376b5fc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5fbc expref: 17 pid: 6520 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582959.856869:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435764096:0@lo:104: 00000100:00100000:3.0:1787582959.856952:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787582959.857004:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909340031600/0x19a47956376b5f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5f76 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.857013:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909340031600/0x19a47956376b5f7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5f76 expref: 17 pid: 6522 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582959.857021:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247674000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435764224:0@lo:104: 00000100:00100000:3.0:1787582959.857042:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582959.857062:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f130240 going to sleep for 11 seconds 00000100:00100000:3.0:1787582959.857084:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435764096 00000100:00100000:3.0:1787582959.857090:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435764096 00000100:00100000:3.0:1787582959.857124:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435764224 00000100:00100000:3.0:1787582959.857127:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435764224 00000100:00100000:3.0:1787582959.857141:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787582959.857149:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247675f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6543:x1874416435764096:12345-0@lo:104: 00010000:00010000:3.0:1787582959.857160:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5fc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.857384:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787582959.857392:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247675f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+4:6543:x1874416435764096:12345-0@lo:104: Request processed in 243us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582959.857399:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787582959.857416:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787582959.857423:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247675500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6543:x1874416435764224:12345-0@lo:104: 00010000:00010000:3.0:1787582959.857431:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5f7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.857472:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787582959.857477:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247675500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+3:6543:x1874416435764224:12345-0@lo:104: Request processed in 55us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582959.857484:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787582959.857662:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787582959.857674:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5fc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.857681:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dede00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787582959.857685:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5fc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.857693:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5fc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582959.857700:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5fc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582959.857706:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582959.857736:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5fc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.857752:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582959.857772:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5fc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.857777:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b5fbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5fc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.857789:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582959.857792:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5f7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.857797:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787582959.857799:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5f7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.857827:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5f7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582959.857833:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5f7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582959.857838:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582959.857867:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.857873:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582959.857878:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.857884:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b5f76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.857896:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582959.857898:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582959.857900:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582959.857906:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582959.857917:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435764352:0@lo:103: 00000100:00100000:1.0:1787582959.857948:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.857979:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582959.857984:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435764480:0@lo:103: 00000100:00100000:1.0:1787582959.858004:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582959.858032:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435764352 00000100:00100000:1.0:1787582959.858036:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435764352 00010000:00010000:1.0:1787582959.858054:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909341481800/0x19a47956376b5fc3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5fbc expref: 18 pid: 6520 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582959.858082:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435764480 00000100:00100000:1.0:1787582959.858085:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435764480 00010000:00010000:1.0:1787582959.858107:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909340031600/0x19a47956376b5f7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5f76 expref: 19 pid: 6522 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582959.858126:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787582959.858133:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3655:x1874416435764352:12345-0@lo:103: 00010000:00010000:1.0:1787582959.858142:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582959.858148:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909341481800/0x19a47956376b5fc3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5fbc expref: 19 pid: 6520 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.858158:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909341481800/0x19a47956376b5fc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5fbc expref: 19 pid: 6520 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.858172:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582959.858199:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3655:x1874416435764352:12345-0@lo:103: Request processed in 67us (251us total) trans 0 rc 0/0 00010000:00010000:3.0:1787582959.858632:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909341481800/0x19a47956376b5fc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5fbc expref: 19 pid: 6520 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582959.858645:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909377f0c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435764096:0@lo:104: 00000100:00100000:3.0:1787582959.858662:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247674000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874416435764224:0@lo:104: 00010000:00010000:3.0:1787582959.858683:0:6543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582959.858734:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787582959.858900:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787582959.858909:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:3655:x1874416435764480:12345-0@lo:103: 00010000:00010000:1.0:1787582959.858918:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582959.858923:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909340031600/0x19a47956376b5f7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5f76 expref: 17 pid: 6522 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.858932:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909340031600/0x19a47956376b5f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5f76 expref: 17 pid: 6522 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.858942:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909340031600/0x19a47956376b5f7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5f76 expref: 17 pid: 6522 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.858961:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.858968:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787582959.858982:0:6513:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007781536s 00010000:00010000:1.0:1787582959.858986:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.858992:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.858997:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.859003:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.859008:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480e00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787582959.859011:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.859017:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.859031:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582959.859041:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582959.859078:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:3655:x1874416435764480:12345-0@lo:103: Request processed in 172us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.859085:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787582959.859123:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435764480:0@lo:103: 00000100:00100000:1.0:1787582959.859132:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435764352:0@lo:103: 00000100:00100000:1.0:1787582959.859194:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:9521:x1874416435763968:12345-0@lo:253: Request processed in 12996us (13308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582959.859202:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:3.0:1787582959.859310:0:6543:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.859319:0:6543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582959.859325:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909341480e00/0x19a47956376b6087 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582959.859979:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5bddce63-0a65-4d1b-a395-d8312cc42532:9521:1874416435763968:0@lo:253: 10000000:01000000:1.0:1787582959.859992:0:9521:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787582959.859996:0:9521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787582959.859998:0:9521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787582959.859999:0:9521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787582959.860001:0:9521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787582959.860002:0:9521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787582959.860003:0:9521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787582959.860005:0:9521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787582959.860006:0:9521:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787582959.860007:0:9521:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787582959.860009:0:9521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787582959.860010:0:9521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787582959.860023:0:9521:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787582959.868830:0:9521:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787582959.869069:0:9521:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787582959.869372:0:9521:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787582959.869650:0:9521:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787582959.870069:0:9521:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787582959.870682:0:9521:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1787582959.872090:0:9521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787582959.882678:0:9521:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787582959.882704:0:9521:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787582959.883007:0:9521:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787582959.883050:0:9521:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787582959.883077:0:9521:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787582959.883099:0:9521:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787582959.884048:0:9521:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787582959.884265:0:9521:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787582959.955694:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787582960.831934:0:9593:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787582960.832208:0:9593:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787582960.974094:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582961.999311:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582962.645733:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582962.645762:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435764608:0@lo:41: 00000100:00100000:1.0:1787582962.645830:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582962.646021:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435764608 00000100:00100000:1.0:1787582962.646028:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435764608 00000100:00100000:1.0:1787582962.646070:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787582962.646078:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435764608:12345-0@lo:41: 00000004:00000024:1.0:1787582962.646110:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1787582962.646156:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435764608:12345-0@lo:41: Request processed in 78us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582962.646253:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787582962.646301:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435764608:0@lo:41: 00010000:00010000:2.0:1787582963.022352:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582963.662641:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787582963.662670:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435764736:0@lo:13: 00000100:00100000:3.0:1787582963.662741:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582963.662822:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435764736 00000100:00100000:3.0:1787582963.662829:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435764736 00000100:00100000:3.0:1787582963.662923:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787582963.662934:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435764736:12345-0@lo:13: 00002000:00000024:3.0:1787582963.662963:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787582963.663008:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435764736:12345-0@lo:13: Request processed in 75us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582963.663015:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787582963.663034:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787582963.663062:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247674000 x1874416435764736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582963.663082:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435764736:0@lo:13: 00000100:00100000:3.0:1787582963.663231:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435764864:0@lo:13: 00000100:00100000:3.0:1787582963.663259:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582963.663287:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435764864 00000100:00100000:3.0:1787582963.663291:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435764864 00000100:00100000:3.0:1787582963.663315:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787582963.663320:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247674000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435764864:12345-0@lo:13: 00002000:00000024:3.0:1787582963.663329:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787582963.663354:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247674000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435764864:12345-0@lo:13: Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582963.663360:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787582963.663372:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787582963.663402:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b62680 x1874416435764864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582963.663415:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435764864:0@lo:13: 00010000:00010000:2.0:1787582964.046923:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582964.687040:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435764992:0@lo:41: 00000100:00100000:1.0:1787582964.687108:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582964.687221:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435764992 00000100:00100000:3.0:1787582964.687230:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435764992 00000100:00100000:3.0:1787582964.687287:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787582964.687295:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435764992:12345-0@lo:41: 00000004:00000024:3.0:1787582964.687326:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787582964.687373:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435764992:12345-0@lo:41: Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582964.687379:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787582964.687612:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435764992:0@lo:41: 00010000:00010000:2.0:1787582965.071376:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582965.198637:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435765120:0@lo:400: 00000100:00100000:3.0:1787582965.198706:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.198752:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435765632:0@lo:400: 00000100:00100000:3.0:1787582965.198776:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.198792:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435766144:0@lo:400: 00000100:00100000:3.0:1787582965.198822:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.198864:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787582965.198871:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435765248:0@lo:400: 00000100:00100000:3.0:1787582965.198896:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.198914:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435765760:0@lo:400: 00000100:00100000:3.0:1787582965.198933:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.199024:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435766272:0@lo:400: 00000100:00100000:3.0:1787582965.199065:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.199097:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435765376:0@lo:400: 00000100:00100000:3.0:1787582965.199120:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.199136:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435765888:0@lo:400: 00000100:00100000:3.0:1787582965.199155:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.199171:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435766400:0@lo:400: 00000100:00100000:3.0:1787582965.199194:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.199215:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787582965.199221:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435765504:0@lo:400: 00000100:00100000:3.0:1787582965.199242:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.199253:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435766016:0@lo:400: 00000100:00100000:3.0:1787582965.199272:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.199315:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435765120 00000100:00100000:3.0:1787582965.199323:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435765120 00000100:00100000:3.0:1787582965.199366:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787582965.199375:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:3653:x1874416435765120:12345-0@lo:400: 00000100:00100000:3.0:1787582965.199421:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+15:3653:x1874416435765120:12345-0@lo:400: Request processed in 46us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.199428:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787582965.199460:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435765632 00000100:00100000:3.0:1787582965.199464:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435765632 00000100:00100000:3.0:1787582965.199492:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435765376 00000100:00100000:3.0:1787582965.199495:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435765376 00000100:00100000:3.0:1787582965.199508:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787582965.199514:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435765632:12345-0@lo:400: 00000100:00100000:3.0:1787582965.199547:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435765632:12345-0@lo:400: Request processed in 32us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.199554:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787582965.199565:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787582965.199571:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435765376:12345-0@lo:400: 00000100:00100000:3.0:1787582965.199602:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435765376:12345-0@lo:400: Request processed in 31us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.199608:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787582965.199625:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435766144 00000100:00100000:3.0:1787582965.199635:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435766144 00000100:00100000:3.0:1787582965.199668:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435766016 00000100:00100000:3.0:1787582965.199671:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435766016 00000100:00100000:3.0:1787582965.199689:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787582965.199696:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435766144:12345-0@lo:400: 00000100:00100000:3.0:1787582965.199726:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435766144:12345-0@lo:400: Request processed in 30us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.199731:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787582965.199743:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787582965.199750:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435766016:12345-0@lo:400: 00000100:00100000:3.0:1787582965.199776:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435766016:12345-0@lo:400: Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.199782:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787582965.199799:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435765248 00000100:00100000:3.0:1787582965.199803:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435765248 00000100:00100000:3.0:1787582965.199819:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435765760 00000100:00100000:3.0:1787582965.199822:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435765760 00000100:00100000:3.0:1787582965.199834:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435766272 00000100:00100000:3.0:1787582965.199836:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435766272 00000100:00100000:3.0:1787582965.199866:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435765888 00000100:00100000:3.0:1787582965.199869:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435765888 00000100:00100000:3.0:1787582965.199883:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435766400 00000100:00100000:3.0:1787582965.199886:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435766400 00000100:00100000:3.0:1787582965.199898:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435765504 00000100:00100000:3.0:1787582965.199900:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435765504 00000100:00100000:3.0:1787582965.199913:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787582965.199919:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435765248:12345-0@lo:400: 00000100:00100000:3.0:1787582965.199949:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435765248:12345-0@lo:400: Request processed in 30us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.199955:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787582965.199974:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787582965.199980:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435765760:12345-0@lo:400: 00000100:00100000:3.0:1787582965.200007:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435765760:12345-0@lo:400: Request processed in 28us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.200013:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787582965.200023:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787582965.200029:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435766272:12345-0@lo:400: 00000100:00100000:3.0:1787582965.200054:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435766272:12345-0@lo:400: Request processed in 25us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.200059:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787582965.200071:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787582965.200077:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435765888:12345-0@lo:400: 00000100:00100000:3.0:1787582965.200103:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435765888:12345-0@lo:400: Request processed in 26us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.200109:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787582965.200121:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787582965.200126:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435766400:12345-0@lo:400: 00000100:00100000:3.0:1787582965.200149:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435766400:12345-0@lo:400: Request processed in 24us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.200154:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787582965.200165:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787582965.200171:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435765504:12345-0@lo:400: 00000100:00100000:3.0:1787582965.200197:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435765504:12345-0@lo:400: Request processed in 26us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.200203:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787582965.200239:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787582965.200249:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787582965.200251:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787582965.200289:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247674a80 x1874416435765504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582965.200303:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435765504:0@lo:400: 00010000:00080000:3.0:1787582965.200314:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247676a00 x1874416435766016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582965.200321:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435766016:0@lo:400: 00000100:00100000:3.0:1787582965.200331:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435765376:0@lo:400: 00010000:00080000:3.0:1787582965.200338:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247676680 x1874416435765888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582965.200345:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435765888:0@lo:400: 00010000:00080000:3.0:1787582965.200354:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247675c00 x1874416435766400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582965.200361:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435766400:0@lo:400: 00010000:00080000:3.0:1787582965.200394:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247677480 x1874416435765248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582965.200402:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435765248:0@lo:400: 00010000:00080000:3.0:1787582965.200412:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247674700 x1874416435765760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582965.200419:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435765760:0@lo:400: 00010000:00080000:3.0:1787582965.200428:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247675880 x1874416435766272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582965.200447:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435766272:0@lo:400: 00000100:00100000:3.0:1787582965.200457:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435765120:0@lo:400: 00000100:00100000:3.0:1787582965.200466:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435765632:0@lo:400: 00010000:00080000:3.0:1787582965.200475:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247674e00 x1874416435766144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582965.200496:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435766144:0@lo:400: 00010000:00010000:2.0:1787582966.094429:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787582966.525788:0:9883:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787582967.143294:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787582967.538017:0:9935:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787582967.544680:0:9935:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787582967.768175:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582967.768205:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435766528:0@lo:41: 00000100:00100000:2.0:1787582967.768278:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582967.768349:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435766528 00000100:00100000:2.0:1787582967.768358:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435766528 00000100:00100000:2.0:1787582967.768407:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787582967.768417:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435766528:12345-0@lo:41: 00000004:00000024:2.0:1787582967.768450:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1787582967.768508:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435766528:12345-0@lo:41: Request processed in 92us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582967.768515:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787582967.768567:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435766528:0@lo:41: 00010000:00010000:3.0:1787582968.207396:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582968.784461:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435766656:0@lo:13: 00000100:00100000:0.0:1787582968.784533:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582968.784613:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582968.784629:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435766784:0@lo:13: 00000100:00100000:0.0:1787582968.784656:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582968.784886:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435766656 00000100:00100000:2.0:1787582968.784894:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435766656 00000100:00100000:2.0:1787582968.784936:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435766784 00000100:00100000:2.0:1787582968.784939:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435766784 00000100:00100000:2.0:1787582968.784957:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787582968.784966:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435766656:12345-0@lo:13: 00002000:00000024:2.0:1787582968.784993:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582968.785039:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435766656:12345-0@lo:13: Request processed in 75us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582968.785045:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787582968.785059:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787582968.785075:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435766784:12345-0@lo:13: 00002000:00000024:2.0:1787582968.785085:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582968.785107:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435766784:12345-0@lo:13: Request processed in 43us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582968.785126:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787582968.785174:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b62a00 x1874416435766784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582968.785194:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435766784:0@lo:13: 00010000:00080000:2.0:1787582968.785205:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092476e1c00 x1874416435766656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582968.785215:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435766656:0@lo:13: 00000100:00080000:0.0:1787582968.785462:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787582969.230061:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787582969.807063:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787582969.807070:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90936d948800 from 39 10000000:01000000:3.0:1787582969.807075:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787582969.807119:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.807131:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.807142:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582969.807167:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435766912:0@lo:101: 00000100:00100000:3.0:1787582969.807236:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582969.807284:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be540 going to sleep for 11 seconds 00000100:00100000:3.0:1787582969.807305:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435766912 00000100:00100000:3.0:1787582969.807312:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435766912 00000100:00100000:3.0:1787582969.807358:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787582969.807369:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435766912:12345-0@lo:101: 00010000:00010000:3.0:1787582969.807394:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582969.807407:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909341481800/0x19a47956376b6095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b608e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.807433:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909341481800/0x19a47956376b6095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b608e expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.807444:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909341481800/0x19a47956376b6095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b608e expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.807469:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481800, rc 0) 00000100:00100000:3.0:1787582969.807507:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435766912:12345-0@lo:101: Request processed in 140us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582969.807514:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787582969.807562:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435766912:0@lo:101: 00010000:00010000:3.0:1787582969.807577:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6095 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.807586:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b6095 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582969.808858:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435767040:0@lo:501: 00000100:00100000:3.0:1787582969.808905:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582969.808931:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be540 going to sleep for 11 seconds 00000100:00100000:3.0:1787582969.808982:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435767040 00000100:00100000:3.0:1787582969.808986:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435767040 00000100:00100000:3.0:1787582969.809018:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787582969.809026:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435767040:12345-0@lo:501: 00000100:00100000:3.0:1787582969.809162:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435767040:12345-0@lo:501: Request processed in 136us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582969.809170:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787582969.809197:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435767168:0@lo:41: 00000100:00100000:3.0:1787582969.809228:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582969.809289:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435767040:0@lo:501: 00000100:00100000:3.0:1787582969.809321:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435767296:0@lo:503: 00000100:00100000:2.0:1787582969.809355:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435767168 00000100:00100000:2.0:1787582969.809362:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435767168 00000100:00100000:3.0:1787582969.809367:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582969.809385:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be540 going to sleep for 11 seconds 00000100:00100000:3.0:1787582969.809403:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435767296 00000100:00100000:2.0:1787582969.809406:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787582969.809409:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435767296 00000100:00100000:2.0:1787582969.809418:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435767168:12345-0@lo:41: 00000100:00100000:3.0:1787582969.809440:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000004:00000024:2.0:1787582969.809459:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787582969.809464:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435767296:12345-0@lo:503: 00000100:00100000:2.0:1787582969.809508:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435767168:12345-0@lo:41: Request processed in 93us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.809516:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787582969.809560:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435767296:12345-0@lo:503: Request processed in 111us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582969.809569:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787582969.809581:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435767168:0@lo:41: 00000100:00100000:3.0:1787582969.809616:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435767296:0@lo:503: 00000100:00100000:1.0:1787582969.822339:0:10000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10000:1874416435767424:0@lo:502: 00000100:00100000:1.0:1787582969.822413:0:10000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.822495:0:10000:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787582969.822539:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435767424 00000100:00100000:3.0:1787582969.822546:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435767424 00000100:00100000:3.0:1787582969.822627:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787582969.822637:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:10000:x1874416435767424:12345-0@lo:502: 00000100:00100000:3.0:1787582969.822927:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:10000:x1874416435767424:12345-0@lo:502: Request processed in 291us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582969.822937:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787582969.823191:0:10000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10000:1874416435767424:0@lo:502: 00000100:00100000:1.0:1787582969.823247:0:10000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10000:1874416435767552:0@lo:502: 00000100:00100000:1.0:1787582969.823288:0:10000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.823321:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435767552 00000100:00100000:1.0:1787582969.823325:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435767552 00000100:00100000:1.0:1787582969.823350:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787582969.823356:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:10000:x1874416435767552:12345-0@lo:502: 00000100:00100000:1.0:1787582969.823433:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:10000:x1874416435767552:12345-0@lo:502: Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.823440:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787582969.823492:0:10000:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787582969.823505:0:10000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10000:1874416435767552:0@lo:502: 00000040:00080000:1.0:1787582969.823526:0:10000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787582969.825900:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787582969.825941:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787582969.825951:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6095 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.825964:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6095 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582969.825974:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787582969.825977:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787582969.825979:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787582969.826012:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.826020:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.826031:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582969.826050:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435767680:0@lo:101: 00000100:00100000:3.0:1787582969.826104:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582969.826140:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582969.826425:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435767680 00000100:00100000:1.0:1787582969.826432:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435767680 00000100:00100000:1.0:1787582969.826494:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787582969.826502:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435767680:12345-0@lo:101: 00010000:00010000:1.0:1787582969.826514:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582969.826525:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367ee00/0x19a47956376b60a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b609c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582969.826546:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367ee00/0x19a47956376b60a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b609c expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582969.826556:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367ee00/0x19a47956376b60a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b609c expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582969.826565:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367ee00, rc 0) 00000100:00100000:1.0:1787582969.826621:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435767680:12345-0@lo:101: Request processed in 109us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.826627:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787582969.827260:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435767680:0@lo:101: 00010000:00010000:1.0:1787582969.827277:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582969.827288:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b60a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582969.827344:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435767808:0@lo:501: 00000100:00100000:1.0:1787582969.827371:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.827391:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582969.827508:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435767808 00000100:00100000:1.0:1787582969.827513:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435767808 00000100:00100000:1.0:1787582969.827541:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787582969.827549:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435767808:12345-0@lo:501: 00000100:00100000:1.0:1787582969.828936:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435767808:12345-0@lo:501: Request processed in 1382us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.828947:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787582969.828991:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435767808:0@lo:501: 00000100:00100000:1.0:1787582969.829026:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435767936:0@lo:503: 00000100:00100000:1.0:1787582969.829064:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.829089:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582969.829102:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435767936 00000100:00100000:1.0:1787582969.829107:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435767936 00000100:00100000:1.0:1787582969.829131:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787582969.829143:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435767936:12345-0@lo:503: 00000100:00100000:1.0:1787582969.829215:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435767936:12345-0@lo:503: Request processed in 73us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.829221:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787582969.829253:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435767936:0@lo:503: 00000100:00100000:1.0:1787582969.829408:0:10002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10002:1874416435768064:0@lo:502: 00000100:00100000:1.0:1787582969.829438:0:10002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.831893:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435768064 00000100:00100000:0.0:1787582969.831906:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435768064 00000100:00100000:0.0:1787582969.831972:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787582969.831983:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:10002:x1874416435768064:12345-0@lo:502: 00000100:00100000:1.0:1787582969.838079:0:10002:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582969.838153:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:10002:x1874416435768064:12345-0@lo:502: Request processed in 6166us (8708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582969.838166:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787582969.838170:0:10002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10002:1874416435768064:0@lo:502: 00000020:01000000:1.0:1787582969.838212:0:10002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582969.838222:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582969.838225:0:10002:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787582969.838234:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787582969.838236:0:10002:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787582969.838375:0:10002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10002:1874416435768192:0@lo:502: 00000100:00100000:1.0:1787582969.838424:0:10002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.838457:0:10002:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582969.838479:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435768192 00000100:00100000:0.0:1787582969.838494:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435768192 00000100:00100000:1.0:1787582969.838580:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787582969.838590:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:10002:x1874416435768192:12345-0@lo:502: 00000100:00100000:1.0:1787582969.839028:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+17:10002:x1874416435768192:12345-0@lo:502: Request processed in 438us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.839035:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787582969.839122:0:10002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10002:1874416435768192:0@lo:502: 00000020:01000000:0.0:1787582969.839142:0:10002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582969.839148:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582969.839150:0:10002:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787582969.839153:0:10002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787582969.839690:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787582969.839713:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787582969.839723:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582969.839748:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582969.839759:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787582969.839762:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90936d90b000 from 39 10000000:01000000:1.0:1787582969.839765:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787582969.839875:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582969.839885:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582969.839894:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582969.839908:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435768320:0@lo:101: 00000100:00100000:1.0:1787582969.839943:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.839969:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787582969.840882:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435768320 00000100:00100000:0.0:1787582969.840891:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435768320 00000100:00100000:0.0:1787582969.840935:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787582969.840944:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435768320:12345-0@lo:101: 00010000:00010000:0.0:1787582969.840955:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582969.840968:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90938216e200/0x19a47956376b60b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b60aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.840989:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90938216e200/0x19a47956376b60b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b60aa expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.840998:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90938216e200/0x19a47956376b60b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b60aa expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.841005:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90938216e200, rc 0) 00000100:00100000:0.0:1787582969.841053:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435768320:12345-0@lo:101: Request processed in 110us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582969.841059:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787582969.841814:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435768320:0@lo:101: 00010000:00010000:2.0:1787582969.841834:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.841861:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b60b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582969.841937:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435768448:0@lo:501: 00000100:00100000:2.0:1787582969.841982:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.842024:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6840 going to sleep for 11 seconds 00000100:00100000:1.0:1787582969.842368:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435768448 00000100:00100000:1.0:1787582969.842380:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435768448 00000100:00100000:1.0:1787582969.842424:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787582969.842432:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435768448:12345-0@lo:501: 00000100:00100000:1.0:1787582969.842578:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435768448:12345-0@lo:501: Request processed in 146us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.842585:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787582969.842771:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435768448:0@lo:501: 00000100:00100000:2.0:1787582969.842805:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435768576:0@lo:503: 00000100:00100000:2.0:1787582969.842868:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.842887:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.842902:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435768576 00000100:00100000:2.0:1787582969.842906:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435768576 00000100:00100000:2.0:1787582969.842933:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787582969.842940:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435768576:12345-0@lo:503: 00000100:00100000:2.0:1787582969.843034:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435768576:12345-0@lo:503: Request processed in 94us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.843041:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787582969.843072:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435768576:0@lo:503: 00000100:00100000:0.0:1787582969.843942:0:10004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10004:1874416435768704:0@lo:502: 00000100:00100000:0.0:1787582969.843988:0:10004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.844024:0:10004:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.844207:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435768704 00000100:00100000:2.0:1787582969.844213:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435768704 00000100:00100000:2.0:1787582969.844251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787582969.844259:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:10004:x1874416435768704:12345-0@lo:502: 00000100:00100000:2.0:1787582969.844363:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:10004:x1874416435768704:12345-0@lo:502: Request processed in 104us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.844370:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787582969.845199:0:10004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10004:1874416435768704:0@lo:502: 00000100:00100000:0.0:1787582969.845261:0:10004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10004:1874416435768832:0@lo:502: 00000100:00100000:0.0:1787582969.845361:0:10004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.845436:0:10004:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787582969.845479:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435768832 00000100:00100000:1.0:1787582969.845486:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435768832 00000100:00100000:1.0:1787582969.845553:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787582969.845570:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:10004:x1874416435768832:12345-0@lo:502: 00000100:00100000:1.0:1787582969.845973:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:10004:x1874416435768832:12345-0@lo:502: Request processed in 404us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.845981:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787582969.846067:0:10004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10004:1874416435768832:0@lo:502: 00000040:00080000:2.0:1787582969.846093:0:10004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787582969.846171:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787582969.846200:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787582969.846210:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.846221:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582969.846230:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787582969.846234:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90936d90b000 from 6 10000000:01000000:0.0:1787582969.846236:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787582969.846262:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.846280:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.846291:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582969.846305:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435768960:0@lo:101: 00000100:00100000:0.0:1787582969.846336:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.846365:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.846761:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435768960 00000100:00100000:2.0:1787582969.846767:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435768960 00000100:00100000:2.0:1787582969.846807:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787582969.846816:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435768960:12345-0@lo:101: 00010000:00010000:2.0:1787582969.846837:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582969.846869:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344dec600/0x19a47956376b60bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b60b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.846893:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344dec600/0x19a47956376b60bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b60b8 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.846904:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344dec600/0x19a47956376b60bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b60b8 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.846913:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dec600, rc 0) 00000100:00100000:2.0:1787582969.846958:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435768960:12345-0@lo:101: Request processed in 144us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.846965:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787582969.846987:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435768960:0@lo:101: 00010000:00010000:0.0:1787582969.847002:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.847017:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582969.847062:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435769088:0@lo:256: 00000100:00100000:0.0:1787582969.847092:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.847119:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787582969.847165:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435769088 00000100:00100000:1.0:1787582969.847169:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435769088 00000100:00100000:1.0:1787582969.847197:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787582969.847204:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435769088:12345-0@lo:256: 20000000:01000000:1.0:1787582969.847217:0:6522:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787582969.847236:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787582969.847238:0:6522:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787582969.847343:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435769088:12345-0@lo:256: Request processed in 139us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.847350:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787582969.847491:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435769088:0@lo:256: 10000000:01000000:2.0:1787582969.847535:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787582969.847542:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.847551:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582969.847560:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787582969.847562:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1787582969.847565:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787582969.847581:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.847587:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.847602:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582969.847615:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435769216:0@lo:101: 00000100:00100000:2.0:1787582969.847644:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.847682:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6600 going to sleep for 11 seconds 00000100:00100000:0.0:1787582969.847688:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435769216 00000100:00100000:0.0:1787582969.847694:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435769216 00000100:00100000:0.0:1787582969.847725:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787582969.847732:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435769216:12345-0@lo:101: 00010000:00010000:0.0:1787582969.847749:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582969.847759:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90938216fe00/0x19a47956376b60cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b60c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.847775:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90938216fe00/0x19a47956376b60cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b60c6 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.847785:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90938216fe00/0x19a47956376b60cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b60c6 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.847792:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90938216fe00, rc 0) 00000100:00100000:0.0:1787582969.847822:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435769216:12345-0@lo:101: Request processed in 90us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582969.847828:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787582969.851837:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435769216:0@lo:101: 00010000:00010000:2.0:1787582969.851885:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.851898:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b60cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582969.851986:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435769344:0@lo:501: 00000100:00100000:2.0:1787582969.852046:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.852095:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6600 going to sleep for 11 seconds 00000100:00100000:1.0:1787582969.852123:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435769344 00000100:00100000:1.0:1787582969.852139:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435769344 00000100:00100000:1.0:1787582969.852189:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787582969.852199:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435769344:12345-0@lo:501: 00000100:00100000:1.0:1787582969.852339:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435769344:12345-0@lo:501: Request processed in 141us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.852347:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787582969.852463:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435769344:0@lo:501: 00000100:00100000:2.0:1787582969.852494:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435769472:0@lo:503: 00000100:00100000:2.0:1787582969.852545:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.852563:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.852578:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435769472 00000100:00100000:2.0:1787582969.852582:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435769472 00000100:00100000:2.0:1787582969.852608:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787582969.852616:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435769472:12345-0@lo:503: 00000100:00100000:2.0:1787582969.852723:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435769472:12345-0@lo:503: Request processed in 107us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.852735:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787582969.852770:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435769472:0@lo:503: 00000100:00100000:0.0:1787582969.853349:0:10005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10005:1874416435769600:0@lo:502: 00000100:00100000:0.0:1787582969.853391:0:10005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.853427:0:10005:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.853521:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435769600 00000100:00100000:2.0:1787582969.853525:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435769600 00000100:00100000:2.0:1787582969.853561:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787582969.853584:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:10005:x1874416435769600:12345-0@lo:502: 00000100:00100000:2.0:1787582969.853883:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:10005:x1874416435769600:12345-0@lo:502: Request processed in 312us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.853891:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787582969.854034:0:10005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10005:1874416435769600:0@lo:502: 00000020:01000000:0.0:1787582969.854059:0:10005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787582969.854068:0:10005:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787582969.854075:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582969.854077:0:10005:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787582969.854082:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787582969.854085:0:10005:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1787582969.854107:0:10005:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787582969.854111:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787582969.854135:0:10005:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90937fbc4d28) 00000020:00000080:0.0:1787582969.854158:0:10005:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1787582969.854166:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787582969.855360:0:10005:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787582969.855371:0:10005:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787582969.855381:0:10005:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x19a47956376b60db 00010000:00080000:0.0:1787582969.855417:0:10005:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909246696800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1787582969.857073:0:10005:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1787582969.857244:0:10005:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787582969.857259:0:10005:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787582969.857484:0:10005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787582969.857688:0:10005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787582969.858428:0:10005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787582969.859409:0:10005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787582969.860413:0:10007:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787582969.860419:0:10007:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787582969.861044:0:10005:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787582969.861055:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787582969.861093:0:10005:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787582969.861115:0:10005:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b60e2 00000100:00080000:0.0:1787582969.861125:0:10005:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787582969.861131:0:10005:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff909246696800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1787582969.861162:0:10005:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90936f15dc00 x1874416435769728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787582969.861202:0:10005:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787582969.861245:0:10005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582969.861249:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582969.861251:0:10005:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787582969.861254:0:10005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582969.861258:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582969.861259:0:10005:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787582969.861262:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787582969.861263:0:10005:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787582969.861288:0:10005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10005:1874416435769856:0@lo:502: 00000100:00100000:0.0:1787582969.861355:0:10005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.861389:0:10005:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0600 going to sleep for 11 seconds 00000100:00100000:0.0:1787582969.861499:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435769984:0@lo:400: 00000100:00100000:1.0:1787582969.861502:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435770240:0@lo:400: 00000100:00100000:0.0:1787582969.861530:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582969.861594:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435769728:0@lo:8: 00000100:00100000:2.0:1787582969.862191:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435769856 00000100:00100000:2.0:1787582969.862199:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435769856 00000100:00100000:2.0:1787582969.862242:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787582969.862252:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+20:10005:x1874416435769856:12345-0@lo:502: 00000100:00100000:3.0:1787582969.862696:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.862840:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.862918:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435769984 00000100:00100000:1.0:1787582969.862924:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435769984 00000100:00100000:1.0:1787582969.862956:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435770240 00000100:00100000:1.0:1787582969.862960:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435770240 00000100:00100000:1.0:1787582969.862985:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787582969.863000:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435769984:12345-0@lo:400: 00000100:00100000:1.0:1787582969.863054:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435769984:12345-0@lo:400: Request processed in 55us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.863062:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787582969.863081:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+20:10005:x1874416435769856:12345-0@lo:502: Request processed in 828us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.863082:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787582969.863095:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787582969.863095:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435770240:12345-0@lo:400: 00000100:00100000:2.0:1787582969.863149:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435770368:0@lo:400: 00000100:00100000:1.0:1787582969.863152:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435770240:12345-0@lo:400: Request processed in 58us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.863161:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787582969.863186:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.863286:0:10005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10005:1874416435769856:0@lo:502: 00000020:01000000:0.0:1787582969.863325:0:10005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582969.863331:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582969.863333:0:10005:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787582969.863337:0:10005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00010000:00080000:1.0:1787582969.863473:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15ce00 x1874416435770240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582969.863476:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435769728 00000100:00100000:3.0:1787582969.863482:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435769728 00000100:00100000:1.0:1787582969.863491:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435770240:0@lo:400: 00000100:00100000:1.0:1787582969.863499:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435770752:0@lo:400: 00000100:00100000:3.0:1787582969.863510:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787582969.863517:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3652:x1874416435769728:12345-0@lo:8: 00000100:00100000:1.0:1787582969.863531:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787582969.863554:0:8752:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 277 last 0 00000100:00100000:1.0:1787582969.863561:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787582969.863570:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435770112:0@lo:400: 00000020:00000080:3.0:1787582969.863587:0:8752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b60e9 00002000:00100000:3.0:1787582969.863602:0:8752:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90937fb93800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787582969.863607:0:8752:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1787582969.863612:0:8752:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787582969.863688:0:8752:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787582969.863753:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.863896:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435770624:0@lo:400: 00000100:00100000:1.0:1787582969.863928:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.863951:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435771136:0@lo:400: 00000100:00100000:1.0:1787582969.863972:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.864009:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435770752 00000100:00100000:1.0:1787582969.864013:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435770752 00000100:00100000:1.0:1787582969.864042:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787582969.864050:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435770752:12345-0@lo:400: 00000100:00100000:1.0:1787582969.864106:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435770752:12345-0@lo:400: Request processed in 57us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.864114:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00002000:00080000:3.0:1787582969.864304:0:8752:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787582969.864331:0:8752:0:(import.c:65:import_set_state_nolock()) ffff90937fb93000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787582969.864374:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1874416435769728:12345-0@lo:8: Request processed in 856us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582969.864381:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787582969.864418:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15dc00 x1874416435769728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787582979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582969.864428:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787582969.864434:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787582969.864441:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787582969.864457:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787582969.864460:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909246696800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787582969.864471:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787582969.864475:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435769728:0@lo:8: 00000004:00080000:3.0:1787582969.864498:0:10007:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:1.0:1787582969.864524:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15c380 x1874416435769984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582969.864535:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435769984:0@lo:400: 00000100:00100000:1.0:1787582969.864543:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435770496:0@lo:400: 00000004:00080000:3.0:1787582969.864553:0:10007:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 277017705931ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787582969.864562:0:10007:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787582969.864574:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.864616:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435771008:0@lo:400: 00000100:00100000:1.0:1787582969.864640:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.865332:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435770624 00000100:00100000:1.0:1787582969.865339:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435770624 00000100:00100000:1.0:1787582969.865376:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435771136 00000100:00100000:1.0:1787582969.865379:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435771136 00000100:00100000:1.0:1787582969.865390:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435770496 00000100:00100000:1.0:1787582969.865392:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435770496 00000100:00100000:1.0:1787582969.865403:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435771008 00000100:00100000:1.0:1787582969.865406:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435771008 00000100:00100000:1.0:1787582969.865420:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787582969.865428:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435770624:12345-0@lo:400: 00000100:00100000:1.0:1787582969.865492:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435770624:12345-0@lo:400: Request processed in 64us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.865498:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787582969.865517:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787582969.865524:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435771136:12345-0@lo:400: 00000100:00100000:1.0:1787582969.865561:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435771136:12345-0@lo:400: Request processed in 39us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.865574:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787582969.865591:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787582969.865608:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435770496:12345-0@lo:400: 00000100:00100000:1.0:1787582969.865644:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435770496:12345-0@lo:400: Request processed in 38us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.866310:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435770880:0@lo:400: 00000100:00100000:2.0:1787582969.866352:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.866403:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435770368 00000100:00100000:2.0:1787582969.866409:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435770368 00000100:00100000:2.0:1787582969.866434:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435770112 00000100:00100000:2.0:1787582969.866437:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435770112 00000100:00100000:2.0:1787582969.866460:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787582969.866468:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435770368:12345-0@lo:400: 00000100:00100000:2.0:1787582969.866519:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435770368:12345-0@lo:400: Request processed in 52us (3334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.866526:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787582969.866541:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787582969.866548:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435770112:12345-0@lo:400: 00000100:00100000:2.0:1787582969.866577:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435770112:12345-0@lo:400: Request processed in 30us (2968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.866583:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000020:01000000:2.0:1787582969.866600:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1787582969.866627:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787582969.866636:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.866646:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582969.866657:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787582969.866660:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff909348740800 from 39 10000000:01000000:2.0:1787582969.866663:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787582969.866708:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.866717:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.866740:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582969.866756:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435771264:0@lo:101: 00000100:00100000:2.0:1787582969.866790:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.866817:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.866836:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435771264 00000100:00100000:2.0:1787582969.866839:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435771264 00000100:00100000:2.0:1787582969.866881:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787582969.866888:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435771264:12345-0@lo:101: 00010000:00010000:2.0:1787582969.866897:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582969.866908:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344ded200/0x19a47956376b60f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b60f0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582969.866909:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1787582969.866934:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344ded200/0x19a47956376b60f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b60f0 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.867163:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344ded200/0x19a47956376b60f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b60f0 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.867174:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344ded200, rc 0) 00000100:00100000:2.0:1787582969.867206:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435771264:12345-0@lo:101: Request processed in 319us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.867212:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787582969.867259:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435771264:0@lo:101: 00010000:00010000:2.0:1787582969.867271:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.867281:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b60f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582969.867332:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435771392:0@lo:501: 00000100:00100000:2.0:1787582969.867429:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.867455:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.867470:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435771392 00000100:00100000:2.0:1787582969.867473:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435771392 00000100:00100000:2.0:1787582969.867499:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787582969.867506:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435771392:12345-0@lo:501: 00000100:00100000:2.0:1787582969.867627:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435771392:12345-0@lo:501: Request processed in 120us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.867633:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787582969.867666:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435771392:0@lo:501: 00000100:00100000:2.0:1787582969.868006:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435771520:0@lo:503: 00000100:00100000:2.0:1787582969.868045:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.868060:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.868073:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435771520 00000100:00100000:2.0:1787582969.868076:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435771520 00000100:00100000:2.0:1787582969.868101:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787582969.868108:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435771520:12345-0@lo:503: 00000100:00100000:2.0:1787582969.868187:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435771520:12345-0@lo:503: Request processed in 79us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.868193:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787582969.868302:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435770880 00000100:00100000:2.0:1787582969.868307:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435770880 00000100:00100000:2.0:1787582969.868337:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787582969.868350:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435770880:12345-0@lo:400: 00000100:00100000:2.0:1787582969.868388:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435770880:12345-0@lo:400: Request processed in 45us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.868404:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787582969.868442:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787582969.868464:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435771008:12345-0@lo:400: 00000100:00100000:3.0:1787582969.868500:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435771008:12345-0@lo:400: Request processed in 41us (3860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582969.868514:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787582969.868608:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435771520:0@lo:503: 00000100:00100000:2.0:1787582969.868665:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435770368:0@lo:400: 00000100:00080000:1.0:1787582969.869008:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787582969.869014:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787582969.869049:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15d180 x1874416435770496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582969.869062:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435770496:0@lo:400: 00010000:00080000:1.0:1787582969.869077:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15ed80 x1874416435771008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787582969.869077:0:7459:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787582969.869089:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435771008:0@lo:400: 00000100:00100000:1.0:1787582969.869132:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435770112:0@lo:400: 00000100:00100000:0.0:1787582969.869140:0:10008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10008:1874416435771648:0@lo:700: 00010000:00080000:1.0:1787582969.869147:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15ca80 x1874416435770624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582969.869156:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435770624:0@lo:400: 00010000:00080000:1.0:1787582969.869169:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924667ca80 x1874416435771136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582969.869177:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435771136:0@lo:400: 00000100:00100000:0.0:1787582969.869184:0:10008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787582969.869262:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15e300 x1874416435770752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787582969.869299:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15f480 x1874416435770880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582969.869310:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435770880:0@lo:400: 00000100:00100000:1.0:1787582969.869340:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435770752:0@lo:400: 00000100:00100000:2.0:1787582969.869344:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435771648 00000100:00100000:2.0:1787582969.869349:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435771648 00000100:00100000:2.0:1787582969.869387:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787582969.869395:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10008:x1874416435771648:12345-0@lo:700: 00000100:00100000:2.0:1787582969.869421:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8452:1874416435771776:0@lo:700: 00000100:00100000:0.0:1787582969.869583:0:10008:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0600 going to sleep for 11 seconds 00000100:00100000:0.0:1787582969.870264:0:10009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10009:1874416435771904:0@lo:502: 00000100:00100000:0.0:1787582969.870375:0:10009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.870412:0:10009:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582969.870633:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435771904 00000100:00100000:3.0:1787582969.870640:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435771904 00000100:00100000:3.0:1787582969.870698:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787582969.870706:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:10009:x1874416435771904:12345-0@lo:502: 00000100:00100000:3.0:1787582969.871045:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:10009:x1874416435771904:12345-0@lo:502: Request processed in 339us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582969.871055:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787582969.871163:0:10009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10009:1874416435771904:0@lo:502: 00000100:00100000:0.0:1787582969.871218:0:10009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10009:1874416435772032:0@lo:502: 00000100:00100000:0.0:1787582969.871254:0:10009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.871286:0:10009:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582969.871391:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435772032 00000100:00100000:3.0:1787582969.871395:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435772032 00000100:00100000:3.0:1787582969.871431:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787582969.871441:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:10009:x1874416435772032:12345-0@lo:502: 00000100:00100000:3.0:1787582969.871526:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:10009:x1874416435772032:12345-0@lo:502: Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582969.871534:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787582969.871604:0:10009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10009:1874416435772032:0@lo:502: 00000040:00080000:0.0:1787582969.871624:0:10009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:2.0:1787582969.872094:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.872125:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6840 going to sleep for 11 seconds 00000100:00080000:2.0:1787582969.872150:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000000:3.0:1787582969.872264:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787582969.872288:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787582969.872299:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582969.872469:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435771776 00000100:00100000:0.0:1787582969.872475:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435771776 00000100:00100000:0.0:1787582969.872518:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582969.872527:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8452:x1874416435771776:12345-0@lo:700: 00010000:00010000:3.0:1787582969.872672:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582969.872955:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787582969.872958:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff909348740800 from 6 10000000:01000000:3.0:1787582969.872962:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787582969.872992:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.873012:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.873022:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582969.873039:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435772160:0@lo:101: 00000100:00100000:3.0:1787582969.873095:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582969.873129:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582969.873200:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435772160 00000100:00100000:0.0:1787582969.873205:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435772160 00000100:00100000:0.0:1787582969.873240:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787582969.873248:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435772160:12345-0@lo:101: 00010000:00010000:0.0:1787582969.873257:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582969.873269:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90938216e400/0x19a47956376b6105 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b60fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.873290:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90938216e400/0x19a47956376b6105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b60fe expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.873300:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90938216e400/0x19a47956376b6105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b60fe expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.873528:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90938216e400, rc 0) 00000100:00100000:0.0:1787582969.873637:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435772160:12345-0@lo:101: Request processed in 389us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582969.873644:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787582969.874042:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435772160:0@lo:101: 00010000:00010000:2.0:1787582969.874060:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.874070:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582969.874191:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435772288:0@lo:256: 00000100:00100000:0.0:1787582969.874227:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.874294:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787582969.874438:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435772288 00000100:00100000:3.0:1787582969.874443:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435772288 00000100:00100000:3.0:1787582969.874530:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787582969.874539:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435772288:12345-0@lo:256: 20000000:01000000:3.0:1787582969.874555:0:6521:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787582969.874573:0:6521:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787582969.874577:0:6521:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787582969.874679:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435772288:12345-0@lo:256: Request processed in 141us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582969.874686:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787582969.874757:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435772288:0@lo:256: 10000000:01000000:0.0:1787582969.874804:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787582969.874811:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.874819:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582969.874827:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787582969.874829:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787582969.874831:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787582969.874872:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.874880:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582969.874888:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582969.874900:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435772416:0@lo:101: 00000100:00100000:0.0:1787582969.874926:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.877604:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a17540 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.878690:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435772416 00000100:00100000:2.0:1787582969.878702:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435772416 00000100:00100000:2.0:1787582969.878951:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787582969.878963:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435772416:12345-0@lo:101: 00010000:00010000:2.0:1787582969.878993:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582969.879010:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344ded000/0x19a47956376b6113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b610c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.879039:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344ded000/0x19a47956376b6113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b610c expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.879051:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344ded000/0x19a47956376b6113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b610c expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.879061:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344ded000, rc 0) 00000100:00100000:2.0:1787582969.879150:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435772416:12345-0@lo:101: Request processed in 189us (4222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.879157:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787582969.879240:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435772416:0@lo:101: 00010000:00010000:2.0:1787582969.879260:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6113 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.879270:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b6113 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582969.879356:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435772544:0@lo:501: 00000100:00100000:2.0:1787582969.879392:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.879424:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.879438:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435772544 00000100:00100000:2.0:1787582969.879441:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435772544 00000100:00100000:2.0:1787582969.879473:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787582969.879480:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435772544:12345-0@lo:501: 00000100:00100000:2.0:1787582969.879618:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435772544:12345-0@lo:501: Request processed in 137us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.879626:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787582969.879659:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435772544:0@lo:501: 00000100:00100000:2.0:1787582969.879956:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435772672:0@lo:503: 00000100:00100000:2.0:1787582969.879997:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.880011:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.880038:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435772672 00000100:00100000:2.0:1787582969.880042:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435772672 00000100:00100000:2.0:1787582969.880060:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787582969.880067:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435772672:12345-0@lo:503: 00000100:00100000:2.0:1787582969.880153:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435772672:12345-0@lo:503: Request processed in 85us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.880159:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787582969.880202:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435772672:0@lo:503: 00000100:00100000:2.0:1787582969.880428:0:10011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10011:1874416435772800:0@lo:502: 40000000:02000000:0.0:1787582969.882533:0:6534:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1787582969.888563:0:10011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582969.888619:0:10011:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935886c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.889767:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435772800 00000100:00100000:2.0:1787582969.889780:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435772800 00000100:00100000:2.0:1787582969.889832:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787582969.889842:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:10011:x1874416435772800:12345-0@lo:502: 00000100:00100000:2.0:1787582969.890039:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:10011:x1874416435772800:12345-0@lo:502: Request processed in 197us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.890048:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787582969.890195:0:10011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10011:1874416435772800:0@lo:502: 00000020:01000000:2.0:1787582969.890236:0:10011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787582969.890245:0:10011:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787582969.890253:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582969.890256:0:10011:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787582969.890260:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787582969.890264:0:10011:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:2.0:1787582969.890285:0:10011:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787582969.890288:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787582969.890302:0:10011:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9092464c8000) 00000020:00000080:2.0:1787582969.890327:0:10011:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1787582969.890333:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787582969.890434:0:10011:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787582969.890441:0:10011:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787582969.890459:0:10011:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b6121 00010000:00080000:2.0:1787582969.890500:0:10011:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90936f2d3000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1787582969.890730:0:10011:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1787582969.890886:0:10011:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787582969.890898:0:10011:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787582969.891073:0:10011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582969.891183:0:10011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582969.891323:0:10011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787582969.891901:0:10011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787582969.896055:0:10012:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787582969.896065:0:10012:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787582969.898032:0:10011:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787582969.898050:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787582969.898097:0:10011:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787582969.898125:0:10011:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b6128 00000100:00080000:2.0:1787582969.898136:0:10011:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787582969.898143:0:10011:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90936f2d3000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787582969.898179:0:10011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909245b61f80 x1874416435772928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787582969.898234:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435772928:0@lo:8: 00000100:00100000:2.0:1787582969.898305:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.898369:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435772928 00000100:00100000:2.0:1787582969.898375:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435772928 00000100:00100000:2.0:1787582969.898404:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787582969.898412:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3652:x1874416435772928:12345-0@lo:8: 00010000:00080000:2.0:1787582969.898441:0:8752:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:2.0:1787582969.898481:0:8752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b612f 00002000:00100000:2.0:1787582969.898495:0:8752:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90936f2d4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787582969.898499:0:8752:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787582969.898502:0:8752:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787582969.898582:0:8752:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787582969.898604:0:8752:0:(import.c:65:import_set_state_nolock()) ffff90936f2d4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787582969.898651:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1874416435772928:12345-0@lo:8: Request processed in 238us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.898659:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787582969.898706:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b61f80 x1874416435772928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787582979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582969.898716:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787582969.898725:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787582969.898732:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787582969.898735:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787582969.898738:0:3652:0:(import.c:65:import_set_state_nolock()) ffff90936f2d3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787582969.898754:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787582969.898759:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435772928:0@lo:8: 00000004:00080000:2.0:1787582969.898793:0:10012:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787582969.898866:0:10012:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 277051998023ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787582969.898874:0:10012:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:2.0:1787582969.899170:0:10011:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787582969.899249:0:10011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582969.899254:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582969.899256:0:10011:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787582969.899260:0:10011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582969.899264:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582969.899265:0:10011:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787582969.899268:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787582969.899270:0:10011:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787582969.899298:0:10011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10011:1874416435773056:0@lo:502: 00000100:00100000:2.0:1787582969.899352:0:10011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.899379:0:10011:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935886ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582969.900441:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435773056 00000100:00100000:0.0:1787582969.900461:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435773056 00000100:00100000:0.0:1787582969.900530:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787582969.900542:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:10011:x1874416435773056:12345-0@lo:502: 00000100:00100000:3.0:1787582969.901492:0:10011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10011:1874416435773056:0@lo:502: 00000020:01000000:3.0:1787582969.901551:0:10011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582969.901560:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582969.901563:0:10011:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787582969.901577:0:10011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:0.0:1787582969.902138:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:10011:x1874416435773056:12345-0@lo:502: Request processed in 1594us (2783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582969.902150:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000020:01000000:2.0:1787582969.902216:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1787582969.902241:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:0.0:1787582969.902251:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8452:x1874416435771776:12345-0@lo:700: Request processed in 29724us (30156us total) trans 0 rc 0/0 00010000:00010000:2.0:1787582969.902252:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6113 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.902266:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6113 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582969.902278:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00000100:00100000:0.0:1787582969.902279:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:2.0:1787582969.902283:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff909343e199b8 from 1 10000000:01000000:2.0:1787582969.902287:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787582969.902321:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.902329:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582969.902348:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582969.902367:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435773184:0@lo:101: 00000100:00100000:2.0:1787582969.902404:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.902436:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00fe40 going to sleep for 11 seconds 00010000:00080000:2.0:1787582969.902489:0:8452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b63800 x1874416435771776/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787582985 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582969.902503:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8452:1874416435771776:0@lo:700: 40000000:02000000:2.0:1787582969.902512:0:8452:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1787582969.906894:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435773184 00000100:00100000:3.0:1787582969.906908:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435773184 00000100:00100000:3.0:1787582969.906974:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787582969.906984:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435773184:12345-0@lo:101: 00010000:00010000:3.0:1787582969.907001:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582969.907018:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909340031600/0x19a47956376b613d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6136 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.907044:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909340031600/0x19a47956376b613d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6136 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.907055:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909340031600/0x19a47956376b613d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6136 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.907064:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909340031600, rc 0) 00000100:00100000:3.0:1787582969.907136:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435773184:12345-0@lo:101: Request processed in 153us (4730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582969.907142:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000004:00080000:1.0:1787582969.907639:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787582969.911410:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435773184:0@lo:101: 00010000:00010000:3.0:1787582969.911440:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b613d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.911587:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b613d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582969.911682:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435773312:0@lo:501: 00000100:00100000:3.0:1787582969.911742:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582969.911785:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0bec00 going to sleep for 11 seconds 00000004:00080000:3.0:1787582969.912368:0:10013:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787582969.912386:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435773440:0@lo:13: 00000100:00100000:3.0:1787582969.912387:0:10013:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10013:1874416435773568:0@lo:7: 00000100:00100000:1.0:1787582969.912434:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582969.913286:0:10013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582969.913315:0:10013:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be240 going to sleep for 11 seconds 00000100:00100000:1.0:1787582969.913894:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435773568 00000100:00100000:1.0:1787582969.913902:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435773568 00000100:00100000:1.0:1787582969.913966:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787582969.913977:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10013:x1874416435773568:12345-0@lo:7: 00000100:00100000:3.0:1787582969.915146:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435773440 00000100:00100000:3.0:1787582969.915154:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435773440 00000100:00100000:3.0:1787582969.915203:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787582969.915214:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874416435773440:12345-0@lo:13: 00002000:00000024:3.0:1787582969.915311:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923902464 avail 3692380160 00000100:00100000:3.0:1787582969.915390:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874416435773440:12345-0@lo:13: Request processed in 178us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582969.915398:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787582969.915432:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435773312 00000100:00100000:3.0:1787582969.915436:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435773312 00000100:00100000:3.0:1787582969.915483:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787582969.915492:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435773312:12345-0@lo:501: 00000100:00100000:3.0:1787582969.915579:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435773312:12345-0@lo:501: Request processed in 88us (3835us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787582969.915587:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787582969.915644:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435773312:0@lo:501: 10000000:01000000:3.0:1787582969.917901:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787582969.917989:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b613d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582969.918002:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b613d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787582969.918644:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787582969.920480:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092476e2d80 x1874416435773440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582969.920511:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435773440:0@lo:13: 00002000:00080000:2.0:1787582969.927578:0:8445:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787582969.927591:0:8445:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787582969.927701:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10013:x1874416435773568:12345-0@lo:7: Request processed in 13721us (14412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.927711:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787582969.927754:0:10013:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092476e3b80 x1874416435773568/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787582985 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582969.927770:0:10013:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10013:1874416435773568:0@lo:7: 00000004:00080000:1.0:1787582969.927785:0:10013:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787582969.927823:0:10013:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10013:1874416435773696:0@lo:5: 00000100:00100000:1.0:1787582969.927875:0:10013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582969.927940:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435773696 00000100:00100000:0.0:1787582969.927948:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435773696 00000001:00100000:3.0:1787582969.932184:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787582969.932195:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787582969.932792:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10008:x1874416435771648:12345-0@lo:700: Request processed in 63383us (63597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.932804:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582969.934875:0:10013:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a188480 going to sleep for 11 seconds 00000100:00100000:0.0:1787582969.935012:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787582969.935029:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10013:x1874416435773696:12345-0@lo:5: 00002000:00080000:1.0:1787582969.937808:0:8752:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787582969.937813:0:8752:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787582969.940553:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10013:x1874416435773696:12345-0@lo:5: Request processed in 5524us (12670us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787582969.940568:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787582969.940933:0:10008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924667d180 x1874416435771648/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787582985 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582969.940951:0:10008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10008:1874416435771648:0@lo:700: 00010000:00080000:0.0:1787582969.948907:0:10013:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245891880 x1874416435773696/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582985 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582969.948931:0:10013:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10013:1874416435773696:0@lo:5: 00000004:00080000:0.0:1787582969.948946:0:10013:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000004:00080000:0.0:1787582969.949673:0:10008:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787582969.949700:0:10008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10008:1874416435773952:0@lo:7: 00000100:00100000:0.0:1787582969.949760:0:10008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.949828:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787582969.949860:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435773824:0@lo:13: 00000100:00100000:1.0:1787582969.949933:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582969.950000:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435773824 00000100:00100000:1.0:1787582969.950007:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435773824 00000100:00100000:1.0:1787582969.950050:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787582969.950058:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435773824:12345-0@lo:13: 00002000:00000024:1.0:1787582969.950077:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923902464 avail 3692380160 00000100:00100000:1.0:1787582969.950118:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435773824:12345-0@lo:13: Request processed in 60us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.950135:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787582969.950170:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924667d880 x1874416435773824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582969.950187:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435773824:0@lo:13: 00000100:00100000:2.0:1787582969.955746:0:10013:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10013:1874416435774080:0@lo:700: 00000100:00100000:2.0:1787582969.955818:0:10013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.955881:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435774080 00000100:00100000:2.0:1787582969.955888:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435774080 00000100:00100000:2.0:1787582969.955937:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582969.955946:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10013:x1874416435774080:12345-0@lo:700: 00000100:00100000:2.0:1787582969.956809:0:10013:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00fe40 going to sleep for 11 seconds 00000001:00080000:3.0:1787582969.959126:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1787582969.962224:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435773952 00000100:00100000:0.0:1787582969.962237:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435773952 00000100:00100000:0.0:1787582969.962299:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787582969.962310:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10008:x1874416435773952:12345-0@lo:7: 00000100:00100000:3.0:1787582969.963493:0:10008:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582969.964213:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10013:x1874416435774080:12345-0@lo:700: Request processed in 8264us (8392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582969.964225:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787582969.964352:0:10013:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b63800 x1874416435774080/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787582985 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582969.964364:0:10013:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787582969.964380:0:10013:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10013:1874416435774080:0@lo:700: 00000004:02000040:2.0:1787582969.974725:0:10013:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1787582969.980705:0:10013:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b62d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10013:1874416435774208:0@lo:5: 00000100:00100000:2.0:1787582969.981107:0:10013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.981160:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435774208 00000100:00100000:2.0:1787582969.981167:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435774208 00000100:00100000:2.0:1787582969.981217:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787582969.981226:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10013:x1874416435774208:12345-0@lo:5: 00000100:00100000:2.0:1787582969.981293:0:10013:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00fd80 going to sleep for 11 seconds 00002000:00080000:0.0:1787582969.989411:0:8442:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787582969.989421:0:8442:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787582969.989776:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10008:x1874416435773952:12345-0@lo:7: Request processed in 27463us (40011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582969.989792:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787582969.990252:0:10008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924667dc00 x1874416435773952/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787582985 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582969.990268:0:10008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10008:1874416435773952:0@lo:7: 00000004:00080000:2.0:1787582969.990284:0:10008:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787582969.990327:0:10008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10008:1874416435774336:0@lo:5: 00000100:00100000:2.0:1787582969.990365:0:10008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.990426:0:10008:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736c1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787582969.991548:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435774336 00000100:00100000:1.0:1787582969.991557:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435774336 00000100:00100000:1.0:1787582969.991613:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787582969.991624:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10008:x1874416435774336:12345-0@lo:5: 00002000:00080000:1.0:1787582969.991655:0:8445:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787582969.991715:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10008:x1874416435774336:12345-0@lo:5: Request processed in 93us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582969.991722:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787582969.991864:0:10008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b63480 x1874416435774336/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582985 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582969.991876:0:10008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10008:1874416435774336:0@lo:5: 00000004:00080000:2.0:1787582969.991897:0:10008:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787582969.992088:0:10008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10008:1874416435774464:0@lo:5: 00000100:00100000:2.0:1787582969.992121:0:10008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.992145:0:10008:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582969.993640:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435774464 00000100:00100000:0.0:1787582969.993651:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435774464 00000100:00100000:0.0:1787582969.993711:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787582969.993720:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10008:x1874416435774464:12345-0@lo:5: 00002000:00080000:0.0:1787582969.993755:0:8442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1787582969.995089:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:10008:x1874416435774464:12345-0@lo:5: Request processed in 1366us (2962us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787582969.995098:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787582969.995206:0:10008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b63480 x1874416435774464/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582985 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582969.995223:0:10008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10008:1874416435774464:0@lo:5: 00000004:00080000:2.0:1787582969.995236:0:10008:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787582969.995278:0:10008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10008:1874416435774592:0@lo:900: 00000100:00100000:2.0:1787582969.995314:0:10008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582969.995358:0:10008:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582969.999071:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435774592 00000100:00100000:0.0:1787582969.999083:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435774592 00000100:00100000:0.0:1787582969.999138:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787582969.999146:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10008:x1874416435774592:12345-0@lo:900: 00000100:00100000:0.0:1787582969.999237:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10008:x1874416435774592:12345-0@lo:900: Request processed in 92us (3923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582969.999244:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787582969.999434:0:10008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b61500 x1874416435774592/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787582985 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582969.999461:0:10008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10008:1874416435774592:0@lo:900: 00002000:00080000:2.0:1787582970.003374:0:8444:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787582970.003396:0:8444:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1787582970.009265:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10013:x1874416435774208:12345-0@lo:5: Request processed in 28034us (28153us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787582970.009277:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787582970.009836:0:10013:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b62d80 x1874416435774208/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582985 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582970.009887:0:10013:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b62d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10013:1874416435774208:0@lo:5: 00000004:00080000:3.0:1787582970.009903:0:10013:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:1.0:1787582970.253990:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787582970.500309:0:10047:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787582970.500793:0:10047:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787582971.278077:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787582971.405556:0:10095:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787582971.405566:0:10095:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1787582971.932336:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582971.932658:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413704320 00000100:00100000:2.0:1787582971.932684:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413704320 00000100:00100000:2.0:1787582971.932749:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:2.0:1787582971.932761:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2403:x1874416413704320:12345-192.168.203.11@tcp:250: 00010000:00080000:2.0:1787582971.932798:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from aa77711a-a697-4098-9892-32db59b6905c@192.168.203.11@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:2.0:1787582971.932838:0:6521:0:(genops.c:1385:class_connect()) connect: client aa77711a-a697-4098-9892-32db59b6905c, cookie 0x19a47956376b6144 00000100:00080000:2.0:1787582971.933119:0:6521:0:(import.c:65:import_set_state_nolock()) ffff90936f2d2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787582971.933228:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+5:2403:x1874416413704320:12345-192.168.203.11@tcp:250: Request processed in 466us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582971.933236:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:2.0:1787582971.947181:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582971.947355:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413704448 00000100:00100000:1.0:1787582971.947366:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413704448 00000100:00100000:1.0:1787582971.947472:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:1.0:1787582971.947484:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+5:6164:x1874416413704448:12345-192.168.203.11@tcp:101: 00010000:00010000:1.0:1787582971.947520:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582971.947547:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367f200/0x19a47956376b614b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c401f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582971.947575:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367f200/0x19a47956376b614b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c401f expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582971.947585:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367f200/0x19a47956376b614b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c401f expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582971.947595:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367f200, rc 0) 00000100:00100000:1.0:1787582971.947656:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+6:6164:x1874416413704448:12345-192.168.203.11@tcp:101: Request processed in 174us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582971.947663:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:3.0:1787582971.954416:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582971.957473:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413704576 00000100:00100000:2.0:1787582971.957488:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413704576 00000100:00100000:0.0:1787582971.960979:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:0.0:1787582971.961010:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+6:6164:x1874416413704576:12345-192.168.203.11@tcp:501: 00000100:00100000:0.0:1787582971.963069:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+6:6164:x1874416413704576:12345-192.168.203.11@tcp:501: Request processed in 2056us (8642us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787582971.963085:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:3.0:1787582971.971951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582971.972031:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413704704 00000100:00100000:2.0:1787582971.972042:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413704704 00000100:00100000:2.0:1787582971.972115:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:2.0:1787582971.972125:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+6:6164:x1874416413704704:12345-192.168.203.11@tcp:101: 00010000:00010000:2.0:1787582971.972142:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582971.972158:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924770a400/0x19a47956376b6152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4026 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582971.972185:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924770a400/0x19a47956376b6152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4026 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582971.972196:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924770a400/0x19a47956376b6152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4026 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582971.972206:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a400, rc 0) 00000100:00100000:2.0:1787582971.972263:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+7:6164:x1874416413704704:12345-192.168.203.11@tcp:101: Request processed in 139us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582971.972269:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:0.0:1787582971.974336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582971.974411:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413704832 00000100:00100000:1.0:1787582971.974420:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413704832 00000100:00100000:1.0:1787582971.974481:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:1.0:1787582971.974492:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+7:6164:x1874416413704832:12345-192.168.203.11@tcp:501: 00000100:00100000:1.0:1787582971.974659:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+8:6164:x1874416413704832:12345-192.168.203.11@tcp:501: Request processed in 168us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582971.974667:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:3.0:1787582971.984227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582971.984381:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413704960 00000100:00100000:2.0:1787582971.984390:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413704960 00000100:00100000:2.0:1787582971.984452:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:2.0:1787582971.984463:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+8:6164:x1874416413704960:12345-192.168.203.11@tcp:503: 00000100:00100000:2.0:1787582971.985814:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+8:6164:x1874416413704960:12345-192.168.203.11@tcp:503: Request processed in 1345us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582971.985831:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:3.0:1787582971.993422:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582971.993648:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413705088 00000100:00100000:1.0:1787582971.993659:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413705088 00000100:00100000:1.0:1787582971.993712:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:1.0:1787582971.993730:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+8:6183:x1874416413705088:12345-192.168.203.11@tcp:502: 00000100:00100000:1.0:1787582971.993945:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+8:6183:x1874416413705088:12345-192.168.203.11@tcp:502: Request processed in 223us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582971.993963:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:0.0:1787582972.050976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582972.051090:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413705216 00000100:00100000:2.0:1787582972.051102:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413705216 00000100:00100000:2.0:1787582972.051180:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:2.0:1787582972.051191:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+8:6183:x1874416413705216:12345-192.168.203.11@tcp:502: 00000100:00100000:2.0:1787582972.051353:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+8:6183:x1874416413705216:12345-192.168.203.11@tcp:502: Request processed in 163us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582972.051361:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:0.0:1787582972.053758:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582972.054016:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413705344 00000100:00100000:3.0:1787582972.054024:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413705344 00000100:00100000:3.0:1787582972.054081:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:3.0:1787582972.054092:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093749e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+8:6164:x1874416413705344:12345-192.168.203.11@tcp:101: 00010000:00010000:3.0:1787582972.054125:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582972.054142:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909340031200/0x19a47956376b6159 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4057 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582972.054169:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909340031200/0x19a47956376b6159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4057 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582972.054178:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909340031200/0x19a47956376b6159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4057 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582972.054187:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909340031200, rc 0) 00000100:00100000:3.0:1787582972.054241:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093749e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+9:6164:x1874416413705344:12345-192.168.203.11@tcp:101: Request processed in 151us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582972.054248:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:3.0:1787582972.057962:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582972.058189:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413705472 00000100:00100000:1.0:1787582972.058201:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413705472 00000100:00100000:1.0:1787582972.058259:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:1.0:1787582972.058269:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093749e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+9:6164:x1874416413705472:12345-192.168.203.11@tcp:256: 20000000:01000000:1.0:1787582972.058297:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787582972.058323:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787582972.058328:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787582972.058331:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787582972.058334:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787582972.058337:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1787582972.060803:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093749e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+9:6164:x1874416413705472:12345-192.168.203.11@tcp:256: Request processed in 2526us (2840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582972.060819:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:0.0:1787582972.068183:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582972.068292:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413705600 00000100:00100000:2.0:1787582972.068302:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413705600 00000100:00100000:2.0:1787582972.068363:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:2.0:1787582972.068373:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909345379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+9:6164:x1874416413705600:12345-192.168.203.11@tcp:101: 00010000:00010000:2.0:1787582972.068391:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582972.068409:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924770a000/0x19a47956376b6160 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c405e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582972.068451:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924770a000/0x19a47956376b6160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c405e expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582972.068464:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924770a000/0x19a47956376b6160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c405e expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582972.068474:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a000, rc 0) 00000100:00100000:2.0:1787582972.068536:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909345379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+10:6164:x1874416413705600:12345-192.168.203.11@tcp:101: Request processed in 164us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582972.068544:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:3.0:1787582972.071688:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582972.071877:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413705728 00000100:00100000:1.0:1787582972.071887:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413705728 00000100:00100000:1.0:1787582972.071947:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:1.0:1787582972.071957:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934537a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:6164:x1874416413705728:12345-192.168.203.11@tcp:501: 00000100:00100000:1.0:1787582972.072461:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934537a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:6164:x1874416413705728:12345-192.168.203.11@tcp:501: Request processed in 502us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582972.072470:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:0.0:1787582972.088139:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582972.088272:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413705856 00000100:00100000:3.0:1787582972.088282:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413705856 00000100:00100000:3.0:1787582972.088338:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:3.0:1787582972.088348:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937702bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:6164:x1874416413705856:12345-192.168.203.11@tcp:503: 00000100:00100000:3.0:1787582972.088510:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937702bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:6164:x1874416413705856:12345-192.168.203.11@tcp:503: Request processed in 163us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582972.088518:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:0.0:1787582972.091259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582972.091881:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413705984 00000100:00100000:2.0:1787582972.091890:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413705984 00000100:00100000:2.0:1787582972.091986:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:2.0:1787582972.092014:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+10:6189:x1874416413705984:12345-192.168.203.11@tcp:502: 00000100:00100000:2.0:1787582972.092230:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+10:6189:x1874416413705984:12345-192.168.203.11@tcp:502: Request processed in 218us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582972.092238:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:0.0:1787582972.095328:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582972.095417:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413706112 00000100:00100000:1.0:1787582972.095426:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413706112 00000100:00100000:1.0:1787582972.095487:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:1.0:1787582972.095497:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:6189:x1874416413706112:12345-192.168.203.11@tcp:502: 00000100:00100000:1.0:1787582972.095659:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:6189:x1874416413706112:12345-192.168.203.11@tcp:502: Request processed in 162us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582972.095674:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:0.0:1787582972.100161:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582972.100445:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413706240 00000100:00100000:3.0:1787582972.100455:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413706240 00000100:00100000:3.0:1787582972.100500:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1787582972.100508:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1874416413706240:12345-192.168.203.11@tcp:38: 00010000:00080000:3.0:1787582972.100551:0:6528:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:3.0:1787582972.100609:0:6528:0:(genops.c:1385:class_connect()) connect: client c54c7da2-d1ec-4db9-98d7-e170a1f2cfae, cookie 0x19a47956376b6167 00000004:00100000:3.0:1787582972.100634:0:6528:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787582972.101313:0:6528:0:(import.c:65:import_set_state_nolock()) ffff90937fb97800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787582972.101416:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2403:x1874416413706240:12345-192.168.203.11@tcp:38: Request processed in 906us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582972.101425:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1787582972.109391:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582972.109491:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413706496 00000100:00100000:1.0:1787582972.109503:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413706496 00000100:00100000:1.0:1787582972.109557:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:1.0:1787582972.109567:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1874416413706496:12345-192.168.203.11@tcp:38: 00010000:00080000:1.0:1787582972.109599:0:6529:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:1.0:1787582972.109666:0:6529:0:(genops.c:1385:class_connect()) connect: client c54c7da2-d1ec-4db9-98d7-e170a1f2cfae, cookie 0x19a47956376b616e 00000004:00100000:1.0:1787582972.109692:0:6529:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787582972.109940:0:6529:0:(import.c:65:import_set_state_nolock()) ffff90936f233000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582972.110009:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2403:x1874416413706496:12345-192.168.203.11@tcp:38: Request processed in 443us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582972.110017:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00010000:00010000:2.0:1787582972.302138:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582972.878157:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582972.878186:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435774720:0@lo:41: 00000100:00100000:3.0:1787582972.878269:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582972.878496:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435774720 00000100:00100000:2.0:1787582972.878505:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435774720 00000100:00100000:2.0:1787582972.878567:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787582972.878577:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435774720:12345-0@lo:41: 00000004:00000024:2.0:1787582972.878608:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787582972.878658:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435774720:12345-0@lo:41: Request processed in 83us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582972.878665:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787582972.878693:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435774720:0@lo:41: 00000100:00100000:3.0:1787582973.119920:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582973.119960:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582973.120023:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413706752 00000100:00100000:0.0:1787582973.120033:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413706752 00000100:00100000:0.0:1787582973.120101:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413706368 00000100:00100000:0.0:1787582973.120105:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413706368 00000100:00100000:0.0:1787582973.120133:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1787582973.120143:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:6164:x1874416413706752:12345-192.168.203.11@tcp:41: 00000004:00000024:0.0:1787582973.120183:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787582973.120242:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:6164:x1874416413706752:12345-192.168.203.11@tcp:41: Request processed in 100us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582973.120250:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1787582973.120266:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1787582973.120273:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:0:x1874416413706368:12345-192.168.203.11@tcp:41: 00000004:00000024:0.0:1787582973.120284:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787582973.120306:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:0:x1874416413706368:12345-192.168.203.11@tcp:41: Request processed in 33us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582973.120312:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00080000:2.0:1787582973.120486:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582973.123723:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582973.123800:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413706880 00000100:00100000:3.0:1787582973.123809:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413706880 00000100:00100000:3.0:1787582973.123898:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1787582973.123909:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6164:x1874416413706880:12345-192.168.203.11@tcp:40: 00000100:00100000:3.0:1787582973.123996:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6164:x1874416413706880:12345-192.168.203.11@tcp:40: Request processed in 89us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582973.124004:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1787582973.127499:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582973.127539:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582973.127612:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413707264 00000100:00100000:1.0:1787582973.127621:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413707264 00000100:00100000:1.0:1787582973.127696:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413706624 00000100:00100000:1.0:1787582973.127699:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413706624 00000100:00100000:1.0:1787582973.127722:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:1.0:1787582973.127731:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413707264:12345-192.168.203.11@tcp:400: 00000100:00100000:1.0:1787582973.127802:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413707264:12345-192.168.203.11@tcp:400: Request processed in 71us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582973.127811:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:3.0:1787582973.127824:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:0:x1874416413706624:12345-192.168.203.11@tcp:41: 00000100:00080000:0.0:1787582973.127889:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1787582973.127893:0:7748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787582973.127931:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:0:x1874416413706624:12345-192.168.203.11@tcp:41: Request processed in 111us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582973.129096:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582973.129132:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582973.129156:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582973.129180:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582973.129205:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413707520 00000100:00100000:2.0:1787582973.129211:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413707520 00000100:00100000:2.0:1787582973.129257:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1787582973.129266:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6164:x1874416413707520:12345-192.168.203.11@tcp:900: 00000100:00100000:2.0:1787582973.129314:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6164:x1874416413707520:12345-192.168.203.11@tcp:900: Request processed in 49us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582973.129338:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1787582973.129462:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:1.0:1787582973.129489:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413707008 00000100:00100000:1.0:1787582973.129493:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413707008 00000100:00100000:1.0:1787582973.129512:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413707392 00000100:00100000:1.0:1787582973.129578:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413707392 00000100:00100000:1.0:1787582973.129597:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1787582973.129603:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1874416413707008:12345-192.168.203.11@tcp:8: 00000100:00100000:2.0:1787582973.129620:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1787582973.129628:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1874416413707392:12345-192.168.203.11@tcp:8: 00010000:00080000:1.0:1787582973.129635:0:8445:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp t0 exp 0000000000000000 cur 280 last 0 00010000:00080000:2.0:1787582973.129650:0:8752:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:1.0:1787582973.129670:0:8445:0:(genops.c:1385:class_connect()) connect: client c54c7da2-d1ec-4db9-98d7-e170a1f2cfae, cookie 0x19a47956376b6175 00002000:00100000:1.0:1787582973.129682:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c54c7da2-d1ec-4db9-98d7-e170a1f2cfae/ffff90936f235000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787582973.129700:0:8445:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:2.0:1787582973.129790:0:8752:0:(genops.c:1385:class_connect()) connect: client c54c7da2-d1ec-4db9-98d7-e170a1f2cfae, cookie 0x19a47956376b617c 00002000:00100000:2.0:1787582973.129799:0:8752:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c54c7da2-d1ec-4db9-98d7-e170a1f2cfae/ffff90936f2d1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787582973.129894:0:8752:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787582973.129931:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787582973.129964:0:8445:0:(import.c:65:import_set_state_nolock()) ffff90936f230800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582973.130006:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2403:x1874416413707008:12345-192.168.203.11@tcp:8: Request processed in 401us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582973.130015:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00002000:00080000:2.0:1787582973.130050:0:8752:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787582973.130068:0:8752:0:(import.c:65:import_set_state_nolock()) ffff90936f2d5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787582973.130093:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2403:x1874416413707392:12345-192.168.203.11@tcp:8: Request processed in 463us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582973.130100:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1787582973.130124:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413707136 00000100:00100000:2.0:1787582973.130128:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413707136 00000100:00100000:2.0:1787582973.130157:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:2.0:1787582973.130164:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937702a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+10:2406:x1874416413707136:12345-192.168.203.11@tcp:400: 00000100:00100000:2.0:1787582973.130188:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937702a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+10:2406:x1874416413707136:12345-192.168.203.11@tcp:400: Request processed in 24us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582973.130195:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:3.0:1787582973.133898:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1787582973.135721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582973.135825:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413707648 00000100:00100000:0.0:1787582973.135836:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413707648 00000100:00100000:0.0:1787582973.135916:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:0.0:1787582973.135928:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6164:x1874416413707648:12345-192.168.203.11@tcp:33: 00000004:00080000:2.0:1787582973.160839:0:6530:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 24806us 00000004:00200000:2.0:1787582973.177038:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787582973.177152:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6164:x1874416413707648:12345-192.168.203.11@tcp:33: Request processed in 41222us (41435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582973.177169:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00010000:00010000:1.0:1787582973.326131:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582973.402120:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582973.402483:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413707776 00000100:00100000:2.0:1787582973.402493:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413707776 00000100:00100000:2.0:1787582973.402612:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1787582973.402623:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6207:x1874416413707776:12345-192.168.203.11@tcp:101: 00010000:00010000:2.0:1787582973.402653:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582973.402722:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770be00/0x19a47956376b6183 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c408f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582973.402805:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b618a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582973.402819:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b618a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582973.402835:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b618a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582973.402916:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787582973.402920:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787582973.402936:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b618a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582973.402966:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770be00/0x19a47956376b6183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c408f expref: 8 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582973.402983:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b618a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c408f expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582973.402991:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff909345181f00) 00010000:00010000:2.0:1787582973.402993:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787582973.403011:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770b000, rc 0) 00000100:00100000:2.0:1787582973.403078:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:6207:x1874416413707776:12345-192.168.203.11@tcp:101: Request processed in 457us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582973.403085:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:1.0:1787582973.902805:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582973.902867:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435774848:0@lo:13: 00000100:00100000:1.0:1787582973.902941:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582973.903322:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435774848 00000100:00100000:2.0:1787582973.903330:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435774848 00000100:00100000:2.0:1787582973.903394:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787582973.903404:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435774848:12345-0@lo:13: 00002000:00000024:2.0:1787582973.903434:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582973.903481:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435774848:12345-0@lo:13: Request processed in 79us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582973.903488:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787582973.903533:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f14f480 x1874416435774848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582973.903552:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435774848:0@lo:13: 00000100:00080000:1.0:1787582973.904044:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787582973.904236:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582973.904249:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435774976:0@lo:13: 00000100:00100000:0.0:1787582973.904287:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582973.904388:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435774976 00000100:00100000:1.0:1787582973.904394:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435774976 00000100:00100000:1.0:1787582973.904450:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787582973.904458:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435774976:12345-0@lo:13: 00002000:00000024:1.0:1787582973.904472:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787582973.904509:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435774976:12345-0@lo:13: Request processed in 52us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582973.904515:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787582973.904685:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787582973.904710:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092476e3b80 x1874416435774976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582973.904727:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435774976:0@lo:13: 00010000:00010000:2.0:1787582974.350095:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582974.926395:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435775232:0@lo:400: 00000100:00100000:0.0:1787582974.926472:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.926529:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435775744:0@lo:400: 00000100:00100000:0.0:1787582974.926553:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.926574:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435776256:0@lo:400: 00000100:00100000:0.0:1787582974.926598:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.926626:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787582974.926632:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435775104:0@lo:400: 00000100:00100000:0.0:1787582974.926659:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.926678:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435775616:0@lo:400: 00000100:00100000:0.0:1787582974.926699:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.926718:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435776128:0@lo:400: 00000100:00100000:0.0:1787582974.926736:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.926751:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435776640:0@lo:400: 00000100:00100000:0.0:1787582974.926767:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.926792:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435775360:0@lo:400: 00000100:00100000:0.0:1787582974.926832:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.926866:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435775872:0@lo:400: 00000100:00100000:0.0:1787582974.926887:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.926902:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435776384:0@lo:400: 00000100:00100000:0.0:1787582974.926940:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.926953:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787582974.926960:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435775488:0@lo:400: 00000100:00100000:0.0:1787582974.926979:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.926989:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435776000:0@lo:400: 00000100:00100000:0.0:1787582974.927006:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.927022:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435776512:0@lo:400: 00000100:00100000:1.0:1787582974.927025:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435775232 00000100:00100000:1.0:1787582974.927032:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435775232 00000100:00100000:0.0:1787582974.927040:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582974.927067:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435775744 00000100:00100000:1.0:1787582974.927070:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435775744 00000100:00100000:0.0:1787582974.927086:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435775616 00000100:00100000:0.0:1787582974.927089:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435775616 00000100:00100000:1.0:1787582974.927098:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435776256 00000100:00100000:1.0:1787582974.927101:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435776256 00000100:00100000:0.0:1787582974.927106:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435775360 00000100:00100000:0.0:1787582974.927109:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435775360 00000100:00100000:1.0:1787582974.927111:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435775872 00000100:00100000:1.0:1787582974.927113:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435775872 00000100:00100000:1.0:1787582974.927124:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435776384 00000100:00100000:1.0:1787582974.927126:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435776384 00000100:00100000:1.0:1787582974.927136:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435775488 00000100:00100000:1.0:1787582974.927139:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435775488 00000100:00100000:1.0:1787582974.927152:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787582974.927160:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435775232:12345-0@lo:400: 00000100:00100000:1.0:1787582974.927214:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435775232:12345-0@lo:400: Request processed in 55us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582974.927221:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787582974.927238:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787582974.927244:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435775744:12345-0@lo:400: 00000100:00100000:1.0:1787582974.927270:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435775744:12345-0@lo:400: Request processed in 27us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582974.927275:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787582974.927287:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787582974.927293:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435776256:12345-0@lo:400: 00000100:00100000:1.0:1787582974.927316:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435776256:12345-0@lo:400: Request processed in 23us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582974.927321:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787582974.927334:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787582974.927339:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435775872:12345-0@lo:400: 00000100:00100000:1.0:1787582974.927367:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435775872:12345-0@lo:400: Request processed in 28us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582974.927372:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787582974.927389:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787582974.927394:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435776384:12345-0@lo:400: 00000100:00100000:0.0:1787582974.927420:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787582974.927428:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435775616:12345-0@lo:400: 00000100:00100000:1.0:1787582974.927431:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435776384:12345-0@lo:400: Request processed in 37us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582974.927435:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787582974.927446:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787582974.927451:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435775488:12345-0@lo:400: 00000100:00100000:0.0:1787582974.927458:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435775616:12345-0@lo:400: Request processed in 32us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582974.927464:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787582974.927471:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435775488:12345-0@lo:400: Request processed in 21us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582974.927475:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787582974.927476:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787582974.927480:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435775360:12345-0@lo:400: 00000100:00100000:0.0:1787582974.927504:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435775360:12345-0@lo:400: Request processed in 24us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582974.927510:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787582974.927533:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787582974.927536:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582974.927545:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435776128 00000100:00100000:0.0:1787582974.927548:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435776128 00000100:00100000:0.0:1787582974.927566:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435776640 00000100:00100000:0.0:1787582974.927568:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435776640 00000100:00100000:0.0:1787582974.927583:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435776000 00000100:00100000:0.0:1787582974.927585:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435776000 00000100:00100000:0.0:1787582974.927595:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435776512 00000100:00100000:0.0:1787582974.927597:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435776512 00000100:00100000:0.0:1787582974.927610:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787582974.927616:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435776128:12345-0@lo:400: 00000100:00100000:0.0:1787582974.927652:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435776128:12345-0@lo:400: Request processed in 36us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582974.927657:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787582974.927667:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787582974.927673:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1874416435776640:12345-0@lo:400: 00000100:00100000:0.0:1787582974.927697:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1874416435776640:12345-0@lo:400: Request processed in 25us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582974.927702:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787582974.927711:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787582974.927716:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435776000:12345-0@lo:400: 00000100:00100000:0.0:1787582974.927738:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435776000:12345-0@lo:400: Request processed in 23us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582974.927743:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787582974.927755:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787582974.927760:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1874416435776512:12345-0@lo:400: 00000100:00100000:0.0:1787582974.927782:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1874416435776512:12345-0@lo:400: Request processed in 23us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582974.927795:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787582974.927810:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787582974.927867:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435775488:0@lo:400: 00010000:00080000:0.0:1787582974.927882:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247675180 x1874416435776000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582974.927892:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435776000:0@lo:400: 00010000:00080000:0.0:1787582974.927902:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247677480 x1874416435776512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582974.927911:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435776512:0@lo:400: 00000100:00100000:0.0:1787582974.927919:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435775360:0@lo:400: 00010000:00080000:0.0:1787582974.927927:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247674e00 x1874416435775872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582974.927934:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435775872:0@lo:400: 00010000:00080000:0.0:1787582974.927943:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247674700 x1874416435776384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582974.927949:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435776384:0@lo:400: 00000100:00100000:0.0:1787582974.927991:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435775616:0@lo:400: 00010000:00080000:0.0:1787582974.928000:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247677b80 x1874416435776128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582974.928007:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435776128:0@lo:400: 00010000:00080000:0.0:1787582974.928016:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247675c00 x1874416435776640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582974.928035:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435776640:0@lo:400: 00000100:00100000:0.0:1787582974.928047:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435775232:0@lo:400: 00000100:00100000:0.0:1787582974.928056:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435775744:0@lo:400: 00000100:00100000:0.0:1787582974.928065:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435776256:0@lo:400: 00000100:00100000:0.0:1787582974.930736:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435776768:0@lo:13: 00000100:00100000:0.0:1787582974.930835:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.930929:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435776768 00000100:00100000:0.0:1787582974.930936:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435776768 00000100:00100000:0.0:1787582974.930982:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787582974.930991:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1874416435776768:12345-0@lo:13: 00002000:00000024:0.0:1787582974.931023:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787582974.931068:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1874416435776768:12345-0@lo:13: Request processed in 77us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582974.931074:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787582974.931111:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247676680 x1874416435776768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582974.931132:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435776768:0@lo:13: 00000100:00100000:0.0:1787582974.936165:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435776896:0@lo:41: 00000100:00100000:0.0:1787582974.936380:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582974.936448:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435776896 00000100:00100000:0.0:1787582974.936455:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435776896 00000100:00100000:0.0:1787582974.936500:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787582974.936509:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435776896:12345-0@lo:41: 00000004:00000024:0.0:1787582974.936567:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787582974.936612:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435776896:12345-0@lo:41: Request processed in 103us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582974.936619:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787582974.936667:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435776896:0@lo:41: 00000100:00100000:2.0:1787582974.939368:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435775104 00000100:00100000:2.0:1787582974.939382:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435775104 00000100:00100000:2.0:1787582974.939497:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787582974.939507:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435775104:12345-0@lo:400: 00000100:00100000:2.0:1787582974.939596:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435775104:12345-0@lo:400: Request processed in 91us (12935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582974.939604:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787582974.939833:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435775104:0@lo:400: 00010000:00010000:2.0:1787582975.374867:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582975.438260:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582975.442422:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435777024:0@lo:13: 00000100:00100000:1.0:1787582975.442504:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582975.447043:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435777024 00000100:00100000:0.0:1787582975.447061:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435777024 00000100:00100000:0.0:1787582975.447142:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787582975.447153:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874416435777024:12345-0@lo:13: 00002000:00000024:0.0:1787582975.447178:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787582975.447264:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874416435777024:12345-0@lo:13: Request processed in 113us (4761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582975.447270:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787582975.447405:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f14e300 x1874416435777024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582975.447434:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435777024:0@lo:13: 00000100:00100000:3.0:1787582975.831172:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582975.831607:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413707904 00000100:00100000:1.0:1787582975.831617:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413707904 00000100:00100000:1.0:1787582975.831709:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:1.0:1787582975.831721:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:6259:x1874416413707904:12345-192.168.203.11@tcp:41: 00000004:00000024:1.0:1787582975.831760:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787582975.831921:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:6259:x1874416413707904:12345-192.168.203.11@tcp:41: Request processed in 202us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582975.831928:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00080000:0.0:1787582975.833116:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582975.838820:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582975.839464:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413708032 00000100:00100000:0.0:1787582975.839480:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413708032 00000100:00100000:0.0:1787582975.839586:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1787582975.839599:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6259:x1874416413708032:12345-192.168.203.11@tcp:41: 00000004:00000024:0.0:1787582975.839652:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787582975.839752:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6259:x1874416413708032:12345-192.168.203.11@tcp:41: Request processed in 154us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582975.839759:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00080000:2.0:1787582975.839985:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787582975.852318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582975.852581:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413708160 00000100:00100000:0.0:1787582975.852595:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413708160 00000100:00100000:0.0:1787582975.852703:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:0.0:1787582975.852717:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6259:x1874416413708160:12345-192.168.203.11@tcp:13: 00002000:00000024:0.0:1787582975.852781:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787582975.852908:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6259:x1874416413708160:12345-192.168.203.11@tcp:13: Request processed in 194us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582975.852916:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00080000:2.0:1787582975.853815:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787582975.867672:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582975.869354:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413708288 00000100:00100000:0.0:1787582975.869374:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413708288 00000100:00100000:0.0:1787582975.869504:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1787582975.869517:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6259:x1874416413708288:12345-192.168.203.11@tcp:13: 00002000:00000024:0.0:1787582975.869552:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787582975.869788:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:6259:x1874416413708288:12345-192.168.203.11@tcp:13: Request processed in 272us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582975.869798:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00080000:1.0:1787582975.870162:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1787582975.960057:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000001:00080000:2.0:1787582975.960080:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1787582975.960095:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787582976.399014:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582977.422127:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582977.998498:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787582977.998537:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435777152:0@lo:41: 00000100:00100000:3.0:1787582977.998607:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582977.999078:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435777152 00000100:00100000:1.0:1787582977.999087:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435777152 00000100:00100000:1.0:1787582977.999137:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787582977.999207:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435777152:12345-0@lo:41: 00000004:00000024:1.0:1787582977.999239:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787582977.999291:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435777152:12345-0@lo:41: Request processed in 87us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582977.999298:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787582977.999401:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435777152:0@lo:41: 00000001:00100000:3.0:1787582978.001040:0:6506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000001:00100000:3.0:1787582978.001349:0:7459:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000100:00100000:3.0:1787582978.320611:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582978.320663:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582978.320710:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582978.320748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582978.320785:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582978.320814:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413708928 00000100:00100000:3.0:1787582978.320826:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413708928 00000100:00100000:3.0:1787582978.320929:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413708800 00000100:00100000:3.0:1787582978.320933:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413708800 00000100:00100000:3.0:1787582978.320962:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1787582978.320975:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247675c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413708928:12345-192.168.203.11@tcp:400: 00000100:00100000:3.0:1787582978.321077:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247675c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413708928:12345-192.168.203.11@tcp:400: Request processed in 105us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582978.321086:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1787582978.321106:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1787582978.321113:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247674700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413708800:12345-192.168.203.11@tcp:400: 00000100:00100000:3.0:1787582978.321139:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247674700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413708800:12345-192.168.203.11@tcp:400: Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582978.321162:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:1.0:1787582978.321839:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413708672 00000100:00100000:1.0:1787582978.321858:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413708672 00000100:00100000:1.0:1787582978.321911:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413708544 00000100:00100000:1.0:1787582978.321914:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413708544 00000100:00100000:1.0:1787582978.321945:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:1.0:1787582978.321954:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413708672:12345-192.168.203.11@tcp:400: 00000100:00100000:1.0:1787582978.322003:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413708672:12345-192.168.203.11@tcp:400: Request processed in 51us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582978.322010:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:1.0:1787582978.322030:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:1.0:1787582978.322037:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413708544:12345-192.168.203.11@tcp:400: 00000100:00100000:1.0:1787582978.322061:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413708544:12345-192.168.203.11@tcp:400: Request processed in 26us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582978.322066:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:2.0:1787582978.322539:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413708416 00000100:00100000:2.0:1787582978.322545:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413708416 00000100:00080000:1.0:1787582978.322582:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582978.322587:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00080000:1.0:1787582978.322587:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787582978.322590:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582978.322594:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:2407:x1874416413708416:12345-192.168.203.11@tcp:400: 00000100:00080000:1.0:1787582978.322594:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787582978.322631:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:2407:x1874416413708416:12345-192.168.203.11@tcp:400: Request processed in 38us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582978.322638:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 197 00010000:00010000:2.0:1787582978.449316:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787582978.831449:0:10193:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787582979.023295:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582979.023322:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435777280:0@lo:13: 00000100:00100000:3.0:1787582979.023405:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582979.023596:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435777280 00000100:00100000:1.0:1787582979.023605:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435777280 00000100:00100000:1.0:1787582979.023681:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787582979.023692:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435777280:12345-0@lo:13: 00002000:00000024:1.0:1787582979.023723:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787582979.023773:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435777280:12345-0@lo:13: Request processed in 83us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582979.023780:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787582979.023805:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787582979.024057:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247674e00 x1874416435777280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582979.024078:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435777280:0@lo:13: 00000001:00100000:3.0:1787582979.027916:0:8437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000100:00100000:0.0:1787582979.032361:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435777408:0@lo:13: 00000100:00100000:0.0:1787582979.032483:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582979.032592:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435777408 00000100:00100000:3.0:1787582979.032605:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435777408 00000100:00100000:2.0:1787582979.032776:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787582979.032789:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435777408:12345-0@lo:13: 00002000:00000024:2.0:1787582979.032814:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582979.032937:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435777408:12345-0@lo:13: Request processed in 150us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582979.032944:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787582979.033695:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787582979.033750:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247674e00 x1874416435777408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582979.033779:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435777408:0@lo:13: 00010000:00010000:2.0:1787582979.470180:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582980.047216:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435777536:0@lo:13: 00000100:00100000:0.0:1787582980.047289:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582980.047437:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435777536 00000100:00100000:3.0:1787582980.047446:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435777536 00000100:00100000:3.0:1787582980.047510:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787582980.047521:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435777536:12345-0@lo:13: 00002000:00000024:3.0:1787582980.047552:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787582980.047596:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435777536:12345-0@lo:13: Request processed in 77us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582980.047603:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787582980.047673:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787582980.047700:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247675180 x1874416435777536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582980.047711:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787582980.047747:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435777536:0@lo:13: 00000100:00100000:3.0:1787582980.050089:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435777664:0@lo:400: 00000100:00100000:3.0:1787582980.050166:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582980.050216:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435778176:0@lo:400: 00000100:00100000:3.0:1787582980.050242:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582980.050259:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435778688:0@lo:400: 00000100:00100000:3.0:1787582980.050281:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582980.050307:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787582980.050322:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435777792:0@lo:400: 00000100:00100000:3.0:1787582980.050361:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582980.050397:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435778304:0@lo:400: 00000100:00100000:3.0:1787582980.050418:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582980.050431:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435778816:0@lo:400: 00000100:00100000:3.0:1787582980.050448:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582980.050483:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435778688 00000100:00100000:3.0:1787582980.050489:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435778688 00000100:00100000:3.0:1787582980.050529:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787582980.050543:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435778688:12345-0@lo:400: 00000100:00100000:3.0:1787582980.050589:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435778688:12345-0@lo:400: Request processed in 47us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582980.050595:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787582980.050632:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924764a300 x1874416435778688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582980.050644:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435778688:0@lo:400: 00000100:00100000:0.0:1787582980.050800:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435777920:0@lo:400: 00000100:00100000:0.0:1787582980.050829:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582980.050878:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435778432:0@lo:400: 00000100:00100000:0.0:1787582980.050899:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582980.050916:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435778944:0@lo:400: 00000100:00100000:0.0:1787582980.050935:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582980.050948:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787582980.050953:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435778048:0@lo:400: 00000100:00100000:0.0:1787582980.050973:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582980.050982:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435778560:0@lo:400: 00000100:00100000:0.0:1787582980.051011:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582980.051028:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435779072:0@lo:400: 00000100:00100000:0.0:1787582980.051049:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582980.051075:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435777792 00000100:00100000:0.0:1787582980.051079:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435777792 00000100:00100000:0.0:1787582980.051099:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435778304 00000100:00100000:0.0:1787582980.051102:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435778304 00000100:00100000:0.0:1787582980.051121:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435778816 00000100:00100000:0.0:1787582980.051124:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435778816 00000100:00100000:0.0:1787582980.051142:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435778432 00000100:00100000:0.0:1787582980.051145:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435778432 00000100:00100000:0.0:1787582980.051158:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435778944 00000100:00100000:0.0:1787582980.051160:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435778944 00000100:00100000:0.0:1787582980.051171:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435778048 00000100:00100000:0.0:1787582980.051172:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435778048 00000100:00100000:0.0:1787582980.051184:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787582980.051190:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435777792:12345-0@lo:400: 00000100:00100000:2.0:1787582980.051313:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787582980.051322:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435778304:12345-0@lo:400: 00000100:00100000:0.0:1787582980.051362:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435777792:12345-0@lo:400: Request processed in 171us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582980.051369:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787582980.051392:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787582980.051399:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435778816:12345-0@lo:400: 00000100:00100000:1.0:1787582980.051462:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435777664 00000100:00100000:1.0:1787582980.051468:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435777664 00000100:00100000:1.0:1787582980.051498:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787582980.051505:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435777664:12345-0@lo:400: 00000100:00100000:3.0:1787582980.051563:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435778176 00000100:00100000:3.0:1787582980.051567:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435778176 00000100:00100000:3.0:1787582980.051586:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435777920 00000100:00100000:3.0:1787582980.051589:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435777920 00000100:00100000:3.0:1787582980.051601:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787582980.051607:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435778176:12345-0@lo:400: 00000100:00100000:2.0:1787582980.052925:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435778304:12345-0@lo:400: Request processed in 1590us (2491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582980.052936:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787582980.053143:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787582980.053150:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435778432:12345-0@lo:400: 00000100:00100000:2.0:1787582980.053228:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435778432:12345-0@lo:400: Request processed in 74us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582980.053234:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787582980.053247:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787582980.053253:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435778944:12345-0@lo:400: 00000100:00100000:2.0:1787582980.053283:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435778944:12345-0@lo:400: Request processed in 30us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582980.053289:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787582980.053300:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787582980.053307:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435778048:12345-0@lo:400: 00000100:00100000:2.0:1787582980.053334:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435778048:12345-0@lo:400: Request processed in 28us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582980.053340:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787582980.053362:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787582980.053388:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435779200:0@lo:41: 00000100:00100000:2.0:1787582980.053429:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582980.053493:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435778560 00000100:00100000:2.0:1787582980.053499:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435778560 00000100:00100000:2.0:1787582980.053552:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435779072 00000100:00100000:2.0:1787582980.053556:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435779072 00000100:00100000:2.0:1787582980.053576:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787582980.053582:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435778560:12345-0@lo:400: 00000100:00100000:2.0:1787582980.053613:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435778560:12345-0@lo:400: Request processed in 31us (2602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582980.053619:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787582980.053643:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787582980.053660:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435779072:12345-0@lo:400: 00000100:00100000:2.0:1787582980.053681:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435779072:12345-0@lo:400: Request processed in 23us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582980.053685:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787582980.053714:0:6532:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787582980.053722:0:6532:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787582980.053817:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435779200 00000100:00100000:2.0:1787582980.053821:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435779200 00000100:00100000:0.0:1787582980.053883:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435778816:12345-0@lo:400: Request processed in 2483us (3431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582980.053893:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787582980.053944:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787582980.053952:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435777920:12345-0@lo:400: 00000100:00080000:0.0:1787582980.053978:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787582980.053983:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787582980.053986:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582980.054021:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435777920:12345-0@lo:400: Request processed in 69us (3190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582980.054028:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435778048:0@lo:400: 00000100:00100000:2.0:1787582980.054030:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787582980.054050:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787582980.054050:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924764b480 x1874416435778560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582980.054062:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3656:x1874416435779200:12345-0@lo:41: 00000100:00100000:0.0:1787582980.054066:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435778560:0@lo:400: 00010000:00080000:0.0:1787582980.054079:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247648700 x1874416435779072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582980.054087:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000004:00000024:2.0:1787582980.054089:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787582980.054103:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435779072:0@lo:400: 00000100:00100000:0.0:1787582980.054115:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435777920:0@lo:400: 00010000:00080000:0.0:1787582980.054130:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924764bb80 x1874416435778432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582980.054134:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3656:x1874416435779200:12345-0@lo:41: Request processed in 73us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582980.054150:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435778432:0@lo:400: 00000100:00100000:2.0:1787582980.054156:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787582980.054166:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247649180 x1874416435778944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582980.054184:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435778944:0@lo:400: 00000100:00100000:2.0:1787582980.054194:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435779200:0@lo:41: 00000100:00100000:0.0:1787582980.054246:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435777792:0@lo:400: 00000100:00100000:0.0:1787582980.054259:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435778304:0@lo:400: 00000100:00100000:0.0:1787582980.054269:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435778816:0@lo:400: 00000100:00100000:1.0:1787582980.054827:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435777664:12345-0@lo:400: Request processed in 3320us (4658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582980.054837:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787582980.055023:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435778176:12345-0@lo:400: Request processed in 3414us (4778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582980.055032:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787582980.055930:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435777664:0@lo:400: 00000100:00100000:1.0:1787582980.055946:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435778176:0@lo:400: 00010000:00010000:2.0:1787582980.493982:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582980.559887:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435779328:0@lo:13: 00000100:00100000:3.0:1787582980.559966:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582980.561619:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435779328 00000100:00100000:0.0:1787582980.561646:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435779328 00000100:00100000:0.0:1787582980.561751:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787582980.561763:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435779328:12345-0@lo:13: 00002000:00000024:0.0:1787582980.561787:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787582980.569188:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435779328:12345-0@lo:13: Request processed in 7418us (9213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582980.569203:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787582980.579115:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f14ca80 x1874416435779328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582980.579143:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435779328:0@lo:13: 00010000:00010000:2.0:1787582981.518925:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582982.551975:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787582983.051708:0:10341:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3fc79d30 20000000:00000080:3.0:1787582983.051728:0:10341:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9092477cf000 uarg=0000000000000000 20000000:01000000:3.0:1787582983.051771:0:10341:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787582983.051774:0:10341:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787582983.051777:0:10341:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787582983.051783:0:10341:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787582983.051789:0:10341:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787582983.057231:0:10341:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787582983.057240:0:10341:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787582983.059981:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1787582983.060323:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1787582983.060363:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1787582983.060380:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1787582983.060390:0:10341:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787582983.060393:0:10341:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787582983.061722:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1787582983.062042:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1787582983.062067:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1787582983.062103:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1787582983.062114:0:10341:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787582983.062116:0:10341:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787582983.062710:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1787582983.063057:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1787582983.063078:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1787582983.063092:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1787582983.063100:0:10341:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787582983.063102:0:10341:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787582983.074888:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1787582983.075481:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1787582983.075514:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1787582983.075528:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1787582983.075540:0:10341:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787582983.075543:0:10341:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787582983.083133:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1787582983.083391:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1787582983.083431:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1787582983.083447:0:10341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:1.0:1787582983.083464:0:10341:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787582983.083484:0:10341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083503:0:10341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90938216e000/0x19a47956376b602c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6025 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083511:0:10341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909341481600/0x19a47956376b6056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b604f expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083525:0:10341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909341481800/0x19a47956376b6095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b608e expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083532:0:10341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367ee00/0x19a47956376b60a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b609c expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083538:0:10341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90938216e200/0x19a47956376b60b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b60aa expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083544:0:10341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90938216fe00/0x19a47956376b60cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b60c6 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083551:0:10341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909344ded200/0x19a47956376b60f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b60f0 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083558:0:10341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909344ded000/0x19a47956376b6113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b610c expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083576:0:10341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909340031600/0x19a47956376b613d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6136 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083586:0:10341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367f200/0x19a47956376b614b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c401f expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083593:0:10341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924770a400/0x19a47956376b6152 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4026 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083600:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083655:0:10341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924770a400/0x19a47956376b6152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4026 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083670:0:10341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90924770a400/0x19a47956376b6152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4026 expref: 9 pid: 6521 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.083686:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435779456:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787582983.083799:0:10341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367f200/0x19a47956376b614b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c401f expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083808:0:10341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90936367f200/0x19a47956376b614b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c401f expref: 9 pid: 6520 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.083817:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435779584:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787582983.083889:0:10341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909340031600/0x19a47956376b613d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b6136 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083897:0:10341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909340031600/0x19a47956376b613d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b6136 expref: 23 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.083906:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435779712:0@lo:104: 00000100:00100000:1.0:1787582983.083952:0:10341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787582983.083987:0:10341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909344ded000/0x19a47956376b6113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b610c expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.083995:0:10341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909344ded000/0x19a47956376b6113 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b610c expref: 23 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.084015:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435779840:0@lo:104: 00000100:00100000:1.0:1787582983.084038:0:10341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787582983.084058:0:10341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909344ded200/0x19a47956376b60f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b60f0 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.084067:0:10341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909344ded200/0x19a47956376b60f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b60f0 expref: 23 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.084075:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435779968:0@lo:104: 00000100:00100000:1.0:1787582983.084095:0:10341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787582983.084110:0:10341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90938216fe00/0x19a47956376b60cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b60c6 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.084117:0:10341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90938216fe00/0x19a47956376b60cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b60c6 expref: 23 pid: 6520 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.084125:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435780096:0@lo:104: 00000100:00100000:1.0:1787582983.084146:0:10341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787582983.084162:0:10341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90938216e200/0x19a47956376b60b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b60aa expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.084171:0:10341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90938216e200/0x19a47956376b60b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b60aa expref: 23 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.084180:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435780224:0@lo:104: 00010000:00010000:1.0:1787582983.084202:0:10341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367ee00/0x19a47956376b60a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b609c expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.084221:0:10341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90936367ee00/0x19a47956376b60a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b609c expref: 23 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.084230:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435780352:0@lo:104: 00010000:00010000:1.0:1787582983.084255:0:10341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909341481800/0x19a47956376b6095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b608e expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.084264:0:10341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909341481800/0x19a47956376b6095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b608e expref: 23 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.084272:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435780480:0@lo:104: 00010000:00010000:1.0:1787582983.084307:0:10341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909341481600/0x19a47956376b6056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b604f expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.084316:0:10341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909341481600/0x19a47956376b6056 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b604f expref: 23 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.084324:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435780608:0@lo:104: 00010000:00010000:1.0:1787582983.084349:0:10341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90938216e000/0x19a47956376b602c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b6025 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.084369:0:10341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90938216e000/0x19a47956376b602c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b6025 expref: 23 pid: 6520 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.084377:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435780736:0@lo:104: 00000100:00100000:1.0:1787582983.084394:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582983.085091:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787582983.085113:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582983.085129:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582983.085139:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582983.085147:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582983.085155:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582983.085163:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435779712 00000100:00100000:2.0:1787582983.085169:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435779712 00000100:00100000:2.0:1787582983.085205:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435779840 00000100:00100000:2.0:1787582983.085209:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435779840 00000100:00100000:2.0:1787582983.085218:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435779968 00000100:00100000:2.0:1787582983.085221:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435779968 00000100:00100000:2.0:1787582983.085230:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435780096 00000100:00100000:2.0:1787582983.085233:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435780096 00000100:00100000:2.0:1787582983.085241:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435780224 00000100:00100000:2.0:1787582983.085244:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435780224 00000100:00100000:2.0:1787582983.085253:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435780352 00000100:00100000:2.0:1787582983.085255:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435780352 00000100:00100000:2.0:1787582983.085262:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435780480 00000100:00100000:2.0:1787582983.085263:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435780480 00000100:00100000:2.0:1787582983.085270:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435780608 00000100:00100000:2.0:1787582983.085271:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435780608 00000100:00100000:2.0:1787582983.085278:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435780736 00000100:00100000:2.0:1787582983.085279:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435780736 00000100:00100000:2.0:1787582983.085290:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787582983.085298:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+11:10341:x1874416435779712:12345-0@lo:104: 00010000:00010000:2.0:1787582983.085311:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b613d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.085378:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787582983.085384:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+11:10341:x1874416435779712:12345-0@lo:104: Request processed in 87us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.085403:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787582983.085420:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787582983.085426:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+10:10341:x1874416435779840:12345-0@lo:104: 00010000:00010000:2.0:1787582983.085434:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b6113 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.085473:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787582983.085478:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+10:10341:x1874416435779840:12345-0@lo:104: Request processed in 53us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.085484:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787582983.085495:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787582983.085501:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+9:10341:x1874416435779968:12345-0@lo:104: 00010000:00010000:2.0:1787582983.085507:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b60f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.085535:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787582983.085539:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+9:10341:x1874416435779968:12345-0@lo:104: Request processed in 40us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.085545:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787582983.085558:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787582983.085563:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+8:10341:x1874416435780096:12345-0@lo:104: 00010000:00010000:2.0:1787582983.085569:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b60cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.085605:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787582983.085609:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+8:10341:x1874416435780096:12345-0@lo:104: Request processed in 47us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.085620:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787582983.085752:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787582983.085760:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+7:10341:x1874416435780224:12345-0@lo:104: 00010000:00010000:2.0:1787582983.085767:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b60b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.085793:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787582983.085798:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+7:10341:x1874416435780224:12345-0@lo:104: Request processed in 40us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.085803:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787582983.085814:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787582983.085820:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+6:10341:x1874416435780352:12345-0@lo:104: 00010000:00010000:2.0:1787582983.085827:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b60a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.085874:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787582983.085879:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+6:10341:x1874416435780352:12345-0@lo:104: Request processed in 60us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.085884:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787582983.085894:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787582983.085899:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:10341:x1874416435780480:12345-0@lo:104: 00010000:00010000:2.0:1787582983.085905:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b6095 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.085928:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787582983.085933:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:10341:x1874416435780480:12345-0@lo:104: Request processed in 35us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.085945:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787582983.085956:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787582983.085962:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:10341:x1874416435780608:12345-0@lo:104: 00010000:00010000:2.0:1787582983.085969:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b6056 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.085996:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1787582983.086001:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:10341:x1874416435780608:12345-0@lo:104: Request processed in 40us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.086005:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787582983.086016:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787582983.086021:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:10341:x1874416435780736:12345-0@lo:104: 00010000:00010000:2.0:1787582983.086027:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b602c expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086049:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1787582983.086053:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:10341:x1874416435780736:12345-0@lo:104: Request processed in 32us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.086059:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1787582983.086082:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1787582983.086089:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b613d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086095:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dede00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787582983.086098:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b613d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086115:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b613d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582983.086121:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b613d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582983.086127:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787582983.086156:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b613d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086162:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582983.086187:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b613d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086193:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344dede00/0x19a47956376b6136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b613d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086206:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1787582983.086209:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b6113 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086214:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90938216f000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787582983.086216:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b6113 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086222:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b6113 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582983.086228:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b6113 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582983.086238:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787582983.086252:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6113 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086258:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582983.086262:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6113 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086268:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90938216f000/0x19a47956376b610c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6113 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086278:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787582983.086281:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b60f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086286:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344deda00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787582983.086288:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b60f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086294:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b60f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582983.086299:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b60f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582983.086303:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787582983.086313:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b60f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086318:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582983.086338:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b60f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086344:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b60f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b60f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086365:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787582983.086368:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b60cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086373:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344decc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787582983.086375:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b60cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086382:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b60cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582983.086387:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b60cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582983.086392:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787582983.086405:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b60cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086411:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582983.086415:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b60cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086422:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b60c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b60cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086431:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787582983.086438:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b60b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086443:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787582983.086446:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b60b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086452:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b60b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582983.086458:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b60b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582983.086462:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787582983.086473:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b60b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086478:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582983.086483:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b60b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086488:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90936367f000/0x19a47956376b60aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b60b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086497:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787582983.086500:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b60a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086506:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481c00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787582983.086509:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b60a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086525:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b60a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582983.086531:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b60a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582983.086536:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787582983.086548:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b60a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086554:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582983.086558:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b60a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.086564:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909341481c00/0x19a47956376b609c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b60a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.086868:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787582983.086875:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b6095 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.086887:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480e00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1787582983.086891:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b6095 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.086897:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b6095 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582983.086902:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b6095 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582983.086907:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582983.086923:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6095 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.086928:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582983.086933:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6095 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.086939:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909341480e00/0x19a47956376b608e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6095 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.086949:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787582983.086952:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b6056 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.086957:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90938216f800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1787582983.086960:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b6056 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.086977:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b6056 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582983.086983:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b6056 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582983.086988:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582983.087001:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6056 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.087007:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582983.087011:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6056 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.087017:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90938216f800/0x19a47956376b604f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6056 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.087026:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582983.087029:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b602c expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.087034:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1787582983.087036:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b602c expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.087042:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b602c expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582983.087049:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b602c expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582983.087058:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582983.087070:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b602c expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.087075:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582983.087079:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b602c expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.087085:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909341481400/0x19a47956376b6025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b602c expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.087094:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582983.087096:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582983.087097:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582983.087226:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435779712:0@lo:104: 00000100:00100000:1.0:1787582983.087237:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435779840:0@lo:104: 00000100:00100000:1.0:1787582983.087254:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435779968:0@lo:104: 00000100:00100000:1.0:1787582983.087262:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435780096:0@lo:104: 00000100:00100000:1.0:1787582983.087270:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435780224:0@lo:104: 00000100:00100000:1.0:1787582983.087276:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435780352:0@lo:104: 00000100:00100000:1.0:1787582983.087283:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435780480:0@lo:104: 00000100:00100000:1.0:1787582983.087290:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435780608:0@lo:104: 00000100:00100000:1.0:1787582983.087297:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435780736:0@lo:104: 00000100:00100000:1.0:1787582983.087334:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435780864:0@lo:103: 00000100:00100000:1.0:1787582983.087396:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582983.088133:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435781376:0@lo:103: 00000100:00100000:1.0:1787582983.088161:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582983.088218:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582983.088220:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582983.088222:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582983.088229:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582983.088240:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435781120:0@lo:103: 00000100:00100000:2.0:1787582983.088271:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435781248:0@lo:103: 00000100:00100000:0.0:1787582983.093829:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435780992:0@lo:103: 00000100:00100000:1.0:1787582983.098256:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435781888:0@lo:103: 00000100:00100000:1.0:1787582983.098315:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582983.100231:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435779456:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787582983.100245:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10341:1874416435779584:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787582983.100290:0:10341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582983.100524:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435780864 00000100:00100000:3.0:1787582983.100532:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435780864 00010000:00010000:3.0:1787582983.100760:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909340031600/0x19a47956376b613d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b6136 expref: 24 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582983.100796:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435781376 00000100:00100000:3.0:1787582983.100799:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435781376 00010000:00010000:3.0:1787582983.100811:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90938216e200/0x19a47956376b60b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b60aa expref: 25 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582983.100831:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787582983.100840:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373f52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+25:3653:x1874416435780864:12345-0@lo:103: 00010000:00010000:3.0:1787582983.100872:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582983.100877:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909340031600/0x19a47956376b613d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b6136 expref: 25 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.100904:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909340031600/0x19a47956376b613d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b6136 expref: 25 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.100921:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909340031600/0x19a47956376b613d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b6136 expref: 25 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.100935:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582983.100988:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373f52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435780864:12345-0@lo:103: Request processed in 149us (13592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582983.100995:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787582983.101032:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787582983.101037:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:3653:x1874416435781376:12345-0@lo:103: 00010000:00010000:3.0:1787582983.101043:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582983.101047:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90938216e200/0x19a47956376b60b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b60aa expref: 23 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.101054:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90938216e200/0x19a47956376b60b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b60aa expref: 23 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.101062:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90938216e200/0x19a47956376b60b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b60aa expref: 23 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.101070:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582983.101087:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:3653:x1874416435781376:12345-0@lo:103: Request processed in 50us (12926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582983.101092:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787582983.103099:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435780864:0@lo:103: 00000100:00100000:1.0:1787582983.103112:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435781376:0@lo:103: 00000100:00100000:1.0:1787582983.103161:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582983.103188:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435781504:0@lo:103: 00000100:00100000:1.0:1787582983.103233:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582983.103262:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435781888 00000100:00100000:1.0:1787582983.103268:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435781888 00010000:00010000:1.0:1787582983.103298:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90938216e000/0x19a47956376b602c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b6025 expref: 22 pid: 6520 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.103318:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435780992 00000100:00100000:1.0:1787582983.103334:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435780992 00010000:00010000:1.0:1787582983.103346:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909344ded000/0x19a47956376b6113 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b610c expref: 23 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.103368:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435781504 00000100:00100000:1.0:1787582983.103371:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435781504 00010000:00010000:1.0:1787582983.103381:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367ee00/0x19a47956376b60a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b609c expref: 24 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.103393:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787582983.103399:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435781888:12345-0@lo:103: 00010000:00010000:1.0:1787582983.103410:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787582983.103503:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787582983.103511:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3654:x1874416435780992:12345-0@lo:103: 00010000:00010000:3.0:1787582983.103525:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582983.103530:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909344ded000/0x19a47956376b6113 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b610c expref: 24 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.103540:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909344ded000/0x19a47956376b6113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b610c expref: 24 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.103556:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344ded000/0x19a47956376b6113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b610c expref: 24 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.103580:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582983.103619:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:3654:x1874416435780992:12345-0@lo:103: Request processed in 109us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582983.103626:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787582983.103772:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787582983.103780:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:3654:x1874416435781504:12345-0@lo:103: 00010000:00010000:3.0:1787582983.103788:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582983.103793:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367ee00/0x19a47956376b60a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b609c expref: 22 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.103801:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367ee00/0x19a47956376b60a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b609c expref: 22 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.103810:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367ee00/0x19a47956376b60a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b609c expref: 22 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582983.103819:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582983.103841:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:3654:x1874416435781504:12345-0@lo:103: Request processed in 63us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582983.103882:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1787582983.104010:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90938216e000/0x19a47956376b602c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b6025 expref: 20 pid: 6520 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.104021:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90938216e000/0x19a47956376b602c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b6025 expref: 20 pid: 6520 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.104031:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90938216e000/0x19a47956376b602c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b6025 expref: 20 pid: 6520 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.104040:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582983.104070:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3653:x1874416435781888:12345-0@lo:103: Request processed in 671us (5754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582983.104076:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787582983.104111:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435780992:0@lo:103: 00000100:00100000:1.0:1787582983.104118:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435781504:0@lo:103: 00000100:00100000:1.0:1787582983.104148:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582983.104174:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435781760:0@lo:103: 00000100:00100000:1.0:1787582983.104206:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582983.104229:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435781248 00000100:00100000:1.0:1787582983.104233:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435781248 00010000:00010000:1.0:1787582983.104246:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90938216fe00/0x19a47956376b60cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b60c6 expref: 19 pid: 6520 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.104261:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435781760 00000100:00100000:1.0:1787582983.104263:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435781760 00010000:00010000:1.0:1787582983.104272:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909341481600/0x19a47956376b6056 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b604f expref: 20 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582983.104282:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787582983.104287:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:3656:x1874416435781248:12345-0@lo:103: 00010000:00010000:1.0:1787582983.104294:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582983.104297:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90938216fe00/0x19a47956376b60cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b60c6 expref: 20 pid: 6520 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.104304:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90938216fe00/0x19a47956376b60cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b60c6 expref: 20 pid: 6520 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.104313:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90938216fe00/0x19a47956376b60cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b60c6 expref: 20 pid: 6520 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.104323:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582983.104349:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3656:x1874416435781248:12345-0@lo:103: Request processed in 62us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582983.104365:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787582983.104377:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787582983.104384:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+18:3656:x1874416435781760:12345-0@lo:103: 00010000:00010000:1.0:1787582983.104390:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582983.104399:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909341481600/0x19a47956376b6056 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b604f expref: 18 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.104407:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909341481600/0x19a47956376b6056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b604f expref: 18 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.106126:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909341481600/0x19a47956376b6056 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b604f expref: 18 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582983.106157:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582983.106225:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+17:3656:x1874416435781760:12345-0@lo:103: Request processed in 1841us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582983.106234:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787582983.106287:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435781248:0@lo:103: 00000100:00100000:1.0:1787582983.106297:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435781760:0@lo:103: 00000100:00100000:1.0:1787582983.106327:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582983.106550:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435781632:0@lo:103: 00000100:00100000:1.0:1787582983.106589:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582983.111012:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435781120 00000100:00100000:2.0:1787582983.111026:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435781120 00010000:00010000:2.0:1787582983.111067:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909344ded200/0x19a47956376b60f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b60f0 expref: 17 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582983.111096:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435781632 00000100:00100000:2.0:1787582983.111111:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435781632 00010000:00010000:2.0:1787582983.111123:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909341481800/0x19a47956376b6095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b608e expref: 18 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582983.111139:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787582983.111158:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247648000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+18:3655:x1874416435781120:12345-0@lo:103: 00010000:00010000:2.0:1787582983.111173:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582983.111178:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909344ded200/0x19a47956376b60f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b60f0 expref: 18 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.111189:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909344ded200/0x19a47956376b60f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b60f0 expref: 18 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.111205:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344ded200/0x19a47956376b60f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b60f0 expref: 18 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.111217:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582983.111290:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247648000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+17:3655:x1874416435781120:12345-0@lo:103: Request processed in 133us (4962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.111298:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787582983.111314:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787582983.111319:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+16:3655:x1874416435781632:12345-0@lo:103: 00010000:00010000:2.0:1787582983.111327:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582983.111331:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909341481800/0x19a47956376b6095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b608e expref: 16 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.111339:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909341481800/0x19a47956376b6095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b608e expref: 16 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.111349:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909341481800/0x19a47956376b6095 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b608e expref: 16 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582983.111374:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582983.111400:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+15:3655:x1874416435781632:12345-0@lo:103: Request processed in 80us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.111406:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787582983.113113:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435781120:0@lo:103: 00000100:00100000:0.0:1787582983.113163:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435781632:0@lo:103: 00000100:00100000:0.0:1787582983.113937:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435781888:0@lo:103: 00000100:00100000:0.0:1787582983.115984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582983.116080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582983.116104:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413709056 00000100:00100000:0.0:1787582983.116112:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413709056 00010000:00010000:0.0:1787582983.116162:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924770a400/0x19a47956376b6152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4026 expref: 10 pid: 6521 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582983.116186:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413709184 00000100:00100000:0.0:1787582983.116189:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413709184 00010000:00010000:0.0:1787582983.116201:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367f200/0x19a47956376b614b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c401f expref: 11 pid: 6520 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582983.116217:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1787582983.116226:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa77711a-a697-4098-9892-32db59b6905c+11:2406:x1874416413709056:12345-192.168.203.11@tcp:103: 00010000:00010000:0.0:1787582983.116241:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582983.116246:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924770a400/0x19a47956376b6152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4026 expref: 11 pid: 6521 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116259:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924770a400/0x19a47956376b6152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4026 expref: 11 pid: 6521 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116276:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924770a400/0x19a47956376b6152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4026 expref: 11 pid: 6521 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116291:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582983.116339:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa77711a-a697-4098-9892-32db59b6905c+10:2406:x1874416413709056:12345-192.168.203.11@tcp:103: Request processed in 113us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582983.116367:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1787582983.116405:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1787582983.116410:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa77711a-a697-4098-9892-32db59b6905c+9:2406:x1874416413709184:12345-192.168.203.11@tcp:103: 00010000:00010000:0.0:1787582983.116428:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582983.116433:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367f200/0x19a47956376b614b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c401f expref: 9 pid: 6520 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116442:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367f200/0x19a47956376b614b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c401f expref: 9 pid: 6520 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116451:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367f200/0x19a47956376b614b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c401f expref: 9 pid: 6520 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116462:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116470:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116484:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116491:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116497:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116503:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116516:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e400 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787582983.116520:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116527:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116541:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116551:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582983.116578:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa77711a-a697-4098-9892-32db59b6905c+8:2406:x1874416413709184:12345-192.168.203.11@tcp:103: Request processed in 157us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582983.116585:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00010000:00010000:0.0:1787582983.116620:0:10341:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116628:0:10341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582983.116634:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367e400/0x19a47956376b6191 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582983.121232:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582983.121255:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435782016:0@lo:41: 00000100:00100000:0.0:1787582983.121320:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582983.122091:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435782016 00000100:00100000:2.0:1787582983.122101:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435782016 00000100:00100000:2.0:1787582983.122151:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787582983.122161:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435782016:12345-0@lo:41: 00000004:00000024:2.0:1787582983.122191:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787582983.122243:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435782016:12345-0@lo:41: Request processed in 83us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.122249:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787582983.122295:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435782016:0@lo:41: 00000100:00100000:3.0:1787582983.438133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582983.438180:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582983.438223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582983.438244:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413709696 00000100:00100000:3.0:1787582983.438245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582983.438254:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413709696 00000100:00100000:3.0:1787582983.438269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582983.438330:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413709824 00000100:00100000:1.0:1787582983.438334:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413709824 00000100:00100000:1.0:1787582983.438367:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1787582983.438378:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413709696:12345-192.168.203.11@tcp:400: 00000100:00100000:0.0:1787582983.438381:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413709312 00000100:00100000:0.0:1787582983.438385:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413709312 00000100:00100000:0.0:1787582983.438411:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 199 00000100:00100000:0.0:1787582983.438430:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+8:2407:x1874416413709312:12345-192.168.203.11@tcp:400: 00000100:00100000:1.0:1787582983.438446:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413709696:12345-192.168.203.11@tcp:400: Request processed in 71us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582983.438453:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:0.0:1787582983.438454:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+8:2407:x1874416413709312:12345-192.168.203.11@tcp:400: Request processed in 25us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582983.438459:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 199 00000100:00100000:1.0:1787582983.438469:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:1.0:1787582983.438481:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413709824:12345-192.168.203.11@tcp:400: 00000100:00080000:0.0:1787582983.438483:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787582983.438487:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787582983.438505:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413709824:12345-192.168.203.11@tcp:400: Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582983.438510:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:2.0:1787582983.438985:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413709440 00000100:00100000:2.0:1787582983.438990:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413709440 00000100:00100000:2.0:1787582983.439040:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413709568 00000100:00100000:2.0:1787582983.439043:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413709568 00000100:00100000:2.0:1787582983.439072:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1787582983.439081:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413709440:12345-192.168.203.11@tcp:400: 00000100:00100000:2.0:1787582983.439120:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413709440:12345-192.168.203.11@tcp:400: Request processed in 41us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.439126:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1787582983.439139:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:2.0:1787582983.439145:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413709568:12345-192.168.203.11@tcp:400: 00000100:00100000:2.0:1787582983.439168:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413709568:12345-192.168.203.11@tcp:400: Request processed in 23us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582983.439181:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00080000:0.0:1787582983.439423:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787582983.439426:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787582983.567070:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582984.142175:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435782144:0@lo:13: 00000100:00100000:1.0:1787582984.142247:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.142635:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582984.142645:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435782272:0@lo:13: 00000100:00100000:2.0:1787582984.142654:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435782144 00000100:00100000:2.0:1787582984.142662:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435782144 00000100:00100000:1.0:1787582984.142699:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582984.142713:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435782272 00000100:00100000:2.0:1787582984.142717:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435782272 00000100:00100000:2.0:1787582984.142736:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787582984.142747:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435782144:12345-0@lo:13: 00002000:00000024:2.0:1787582984.142777:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582984.142842:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435782144:12345-0@lo:13: Request processed in 97us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582984.142876:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787582984.142879:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582984.142898:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787582984.142905:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435782272:12345-0@lo:13: 00002000:00000024:2.0:1787582984.142914:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582984.142935:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435782272:12345-0@lo:13: Request processed in 31us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582984.142940:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787582984.143175:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092477ded80 x1874416435782272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582984.143194:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435782272:0@lo:13: 00010000:00080000:1.0:1787582984.143204:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092477df100 x1874416435782144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582984.143214:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435782144:0@lo:13: 10000000:01000000:1.0:1787582984.272398:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787582984.272406:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90936db2f000 from 48 10000000:01000000:1.0:1787582984.272412:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787582984.272464:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.272476:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.272488:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582984.272557:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435782400:0@lo:101: 00000100:00100000:1.0:1787582984.272629:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.272716:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787582984.272721:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435782400 00000100:00100000:2.0:1787582984.272729:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435782400 00000100:00100000:2.0:1787582984.272779:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787582984.272789:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+15:6525:x1874416435782400:12345-0@lo:101: 00010000:00010000:2.0:1787582984.272812:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582984.272825:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924770b800/0x19a47956376b619f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6198 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.272870:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924770b800/0x19a47956376b619f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6198 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.272894:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924770b800/0x19a47956376b619f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6198 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.272902:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770b800, rc 0) 00000100:00100000:2.0:1787582984.272957:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435782400:12345-0@lo:101: Request processed in 169us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582984.272963:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787582984.274627:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435782400:0@lo:101: 00010000:00010000:1.0:1787582984.274655:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.274666:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582984.274746:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435782528:0@lo:501: 00000100:00100000:1.0:1787582984.274791:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.274836:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787582984.275168:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435782528 00000100:00100000:2.0:1787582984.275174:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435782528 00000100:00100000:2.0:1787582984.275222:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787582984.275231:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435782528:12345-0@lo:501: 00000100:00100000:2.0:1787582984.275392:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435782528:12345-0@lo:501: Request processed in 162us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582984.275399:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787582984.277913:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435782528:0@lo:501: 00000100:00100000:1.0:1787582984.277977:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435782656:0@lo:503: 00000100:00100000:1.0:1787582984.278052:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.278101:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787582984.278123:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435782656 00000100:00100000:2.0:1787582984.278130:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435782656 00000100:00100000:0.0:1787582984.278187:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787582984.278198:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435782656:12345-0@lo:503: 00000100:00100000:0.0:1787582984.278314:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435782656:12345-0@lo:503: Request processed in 118us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.278372:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435782656:0@lo:503: 00000100:00100000:1.0:1787582984.280686:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10358:1874416435782784:0@lo:502: 00000100:00100000:1.0:1787582984.280763:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.280806:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.281103:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435782784 00000100:00100000:3.0:1787582984.281112:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435782784 00000100:00100000:0.0:1787582984.285070:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787582984.287897:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787582984.287923:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:10358:x1874416435782784:12345-0@lo:502: 00000100:00100000:3.0:1787582984.288185:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:10358:x1874416435782784:12345-0@lo:502: Request processed in 275us (7423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582984.288193:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787582984.289046:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10358:1874416435782784:0@lo:502: 00000100:00100000:1.0:1787582984.289120:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10358:1874416435782912:0@lo:502: 00000100:00100000:1.0:1787582984.289184:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.289271:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582984.290032:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435782912 00000100:00100000:0.0:1787582984.290041:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435782912 00000100:00100000:0.0:1787582984.290146:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787582984.290157:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:10358:x1874416435782912:12345-0@lo:502: 00000100:00100000:0.0:1787582984.290301:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+16:10358:x1874416435782912:12345-0@lo:502: Request processed in 146us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582984.290308:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787582984.290399:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10358:1874416435782912:0@lo:502: 00000040:00080000:1.0:1787582984.290435:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787582984.290602:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787582984.290631:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787582984.290640:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.290651:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582984.290661:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787582984.290664:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787582984.290667:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787582984.290693:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.290701:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.290710:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582984.290726:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435783040:0@lo:101: 00000100:00100000:1.0:1787582984.290756:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.300386:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.300804:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435783040 00000100:00100000:3.0:1787582984.300815:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435783040 00000100:00100000:3.0:1787582984.300895:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787582984.301191:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+16:6525:x1874416435783040:12345-0@lo:101: 00010000:00010000:3.0:1787582984.301208:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582984.301226:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909340031600/0x19a47956376b61ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b61a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.301252:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909340031600/0x19a47956376b61ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b61a6 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.301263:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909340031600/0x19a47956376b61ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b61a6 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.301292:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909340031600, rc 0) 00000100:00100000:3.0:1787582984.301401:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435783040:12345-0@lo:101: Request processed in 497us (10643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582984.301416:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787582984.301895:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435783040:0@lo:101: 00010000:00010000:1.0:1787582984.301912:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.301929:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582984.302006:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435783168:0@lo:501: 00000100:00100000:1.0:1787582984.302038:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.302114:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.302171:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435783168 00000100:00100000:3.0:1787582984.302176:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435783168 00000100:00100000:3.0:1787582984.302199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787582984.302206:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435783168:12345-0@lo:501: 00000100:00100000:3.0:1787582984.302332:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435783168:12345-0@lo:501: Request processed in 126us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582984.302338:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787582984.302972:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435783168:0@lo:501: 00000100:00100000:1.0:1787582984.303014:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435783296:0@lo:503: 00000100:00100000:1.0:1787582984.303063:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.303088:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.303158:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435783296 00000100:00100000:3.0:1787582984.303163:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435783296 00000100:00100000:3.0:1787582984.303186:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787582984.303192:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435783296:12345-0@lo:503: 00000100:00100000:3.0:1787582984.303318:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435783296:12345-0@lo:503: Request processed in 125us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582984.303325:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787582984.303734:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435783296:0@lo:503: 00000100:00100000:1.0:1787582984.304371:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10359:1874416435783424:0@lo:502: 00000100:00100000:1.0:1787582984.304430:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582984.304648:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435783424 00000100:00100000:3.0:1787582984.304654:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435783424 00000100:00100000:3.0:1787582984.304683:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787582984.304690:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:10359:x1874416435783424:12345-0@lo:502: 00000100:00100000:3.0:1787582984.304947:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:10359:x1874416435783424:12345-0@lo:502: Request processed in 256us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582984.304954:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787582984.305171:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.305188:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10359:1874416435783424:0@lo:502: 00000020:01000000:1.0:1787582984.305210:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582984.305219:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582984.305221:0:10359:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787582984.305228:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787582984.305247:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10359:1874416435783552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582984.305277:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.305295:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.305338:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435783552 00000100:00100000:3.0:1787582984.305352:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435783552 00000100:00100000:3.0:1787582984.305373:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787582984.305378:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:10359:x1874416435783552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582984.305470:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:10359:x1874416435783552:12345-0@lo:502:llog_process_th.0 Request processed in 90us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582984.305477:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787582984.305864:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10359:1874416435783552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582984.305883:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582984.305894:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582984.305895:0:10359:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787582984.305900:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1787582984.306059:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787582984.306077:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787582984.306086:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.306097:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582984.306107:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787582984.306110:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90936d948800 from 48 10000000:01000000:3.0:1787582984.306112:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787582984.306134:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.306141:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.306149:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582984.306161:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435783680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.306188:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582984.306223:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936eea66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.306263:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435783680 00000100:00100000:1.0:1787582984.306267:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435783680 00000100:00100000:1.0:1787582984.306286:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787582984.306292:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+17:6525:x1874416435783680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582984.306300:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582984.306311:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367fa00/0x19a47956376b61bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b61b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.306329:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367fa00/0x19a47956376b61bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b61b4 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.306338:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367fa00/0x19a47956376b61bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b61b4 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.306357:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367fa00, rc 0) 00000100:00100000:1.0:1787582984.306394:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435783680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.306399:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787582984.306812:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435783680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582984.306826:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.306835:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582984.306912:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435783808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.306941:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582984.306959:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936eea66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.307022:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435783808 00000100:00100000:1.0:1787582984.307028:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435783808 00000100:00100000:1.0:1787582984.307049:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787582984.307054:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435783808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.307164:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435783808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.307171:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787582984.307273:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435783808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.307295:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435783936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.307330:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582984.307364:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936eea66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.307399:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435783936 00000100:00100000:1.0:1787582984.307409:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435783936 00000100:00100000:1.0:1787582984.307435:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787582984.307440:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435783936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.307758:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435783936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 317us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.307765:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787582984.307842:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435783936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.308186:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10360:1874416435784064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582984.308221:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582984.308248:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936eea6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.308286:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435784064 00000100:00100000:1.0:1787582984.308290:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435784064 00000100:00100000:1.0:1787582984.308309:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787582984.308315:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:10360:x1874416435784064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582984.308476:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10360:1874416435784064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582984.308779:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10360:1874416435784192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582984.308813:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582984.308823:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.308879:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:10360:x1874416435784064:12345-0@lo:502:llog_process_th.0 Request processed in 95us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.308887:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787582984.308911:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435784192 00000100:00100000:1.0:1787582984.308916:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435784192 00000100:00100000:1.0:1787582984.308932:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787582984.308939:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:10360:x1874416435784192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582984.309003:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+18:10360:x1874416435784192:12345-0@lo:502:llog_process_th.0 Request processed in 63us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.309009:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787582984.309089:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10360:1874416435784192:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787582984.309117:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787582984.310023:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787582984.310046:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787582984.310056:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.310066:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582984.310090:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787582984.310093:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787582984.310095:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787582984.310122:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.310129:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.310137:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582984.310166:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435784320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.310205:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.310229:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787582984.310451:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435784320 00000100:00100000:2.0:1787582984.310459:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435784320 00000100:00100000:2.0:1787582984.310494:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787582984.310502:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+18:6525:x1874416435784320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582984.310531:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582984.310544:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924770aa00/0x19a47956376b61c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b61c2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.310576:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924770aa00/0x19a47956376b61c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b61c2 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.310587:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924770aa00/0x19a47956376b61c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b61c2 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.311007:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770aa00, rc 0) 00000100:00100000:2.0:1787582984.311060:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435784320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 557us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582984.311067:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787582984.311195:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435784320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582984.311211:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.311221:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582984.311280:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435784448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.311307:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.311383:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.311596:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435784448 00000100:00100000:3.0:1787582984.311718:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435784448 00000100:00100000:3.0:1787582984.311796:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787582984.311805:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435784448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.311965:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435784448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582984.311972:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787582984.312077:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435784448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.312103:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435784576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.312145:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.312247:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787582984.312302:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435784576 00000100:00100000:0.0:1787582984.312307:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435784576 00000100:00100000:0.0:1787582984.312326:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787582984.312332:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435784576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582984.312464:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435784576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582984.312480:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787582984.312651:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435784576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.312840:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10361:1874416435784704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582984.312896:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.312906:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787582984.313532:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435784704 00000100:00100000:0.0:1787582984.313538:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435784704 00000100:00100000:0.0:1787582984.313564:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787582984.313571:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:10361:x1874416435784704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582984.313802:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:10361:x1874416435784704:12345-0@lo:502:llog_process_th.0 Request processed in 231us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582984.313809:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787582984.313980:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10361:1874416435784704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582984.314007:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582984.314016:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582984.314019:0:10361:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787582984.314026:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787582984.314053:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10361:1874416435784832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582984.314089:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.314112:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787582984.314212:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435784832 00000100:00100000:0.0:1787582984.314216:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435784832 00000100:00100000:0.0:1787582984.314235:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787582984.314241:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:10361:x1874416435784832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582984.314305:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:10361:x1874416435784832:12345-0@lo:502:llog_process_th.0 Request processed in 63us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582984.314311:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787582984.314404:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10361:1874416435784832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582984.314422:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582984.314426:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582984.314428:0:10361:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787582984.314432:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1787582984.314720:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787582984.314738:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787582984.314746:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582984.314758:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582984.314767:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787582984.314770:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90936d90b000 from 48 10000000:01000000:0.0:1787582984.314772:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787582984.314794:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582984.314807:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582984.314817:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582984.314830:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435784960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787582984.314884:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582984.314909:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.315055:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435784960 00000100:00100000:1.0:1787582984.315060:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435784960 00000100:00100000:1.0:1787582984.315079:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787582984.315084:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+19:6525:x1874416435784960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582984.315093:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582984.315102:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367f200/0x19a47956376b61d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b61d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.315131:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367f200/0x19a47956376b61d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b61d0 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.315140:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367f200/0x19a47956376b61d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b61d0 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.315148:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367f200, rc 0) 00000100:00100000:1.0:1787582984.315174:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435784960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.315180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787582984.315240:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435784960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582984.315251:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582984.315260:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582984.315303:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435785088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582984.315323:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582984.315356:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.315392:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435785088 00000100:00100000:1.0:1787582984.315395:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435785088 00000100:00100000:1.0:1787582984.315412:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787582984.315417:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435785088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.315538:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435785088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.315545:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787582984.315722:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435785088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582984.315749:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435785216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582984.315784:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582984.315805:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.315929:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435785216 00000100:00100000:1.0:1787582984.315933:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435785216 00000100:00100000:1.0:1787582984.315951:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787582984.315956:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435785216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.316027:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435785216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.316034:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787582984.316106:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435785216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582984.316385:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10362:1874416435785344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582984.316421:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582984.316456:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.316694:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435785344 00000100:00100000:1.0:1787582984.316698:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435785344 00000100:00100000:1.0:1787582984.316724:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787582984.316729:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:10362:x1874416435785344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582984.316811:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+20:10362:x1874416435785344:12345-0@lo:502:llog_process_th.0 Request processed in 81us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.316818:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787582984.316917:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10362:1874416435785344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582984.316953:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10362:1874416435785472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582984.316985:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582984.317012:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.317082:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435785472 00000100:00100000:3.0:1787582984.317087:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435785472 00000100:00100000:3.0:1787582984.317110:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787582984.317117:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+20:10362:x1874416435785472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582984.317186:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+20:10362:x1874416435785472:12345-0@lo:502:llog_process_th.0 Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582984.317193:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787582984.317797:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10362:1874416435785472:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787582984.317822:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787582984.321999:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787582984.322045:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787582984.322057:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.322068:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582984.322080:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787582984.322083:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1787582984.322086:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787582984.322126:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.322135:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582984.322145:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582984.322170:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435785600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.322233:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582984.322265:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a5d1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.322355:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435785600 00000100:00100000:3.0:1787582984.322362:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435785600 00000100:00100000:3.0:1787582984.322411:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787582984.322422:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435785600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582984.322435:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582984.322718:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909340030800/0x19a47956376b61e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b61de expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.322744:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909340030800/0x19a47956376b61e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b61de expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.322756:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909340030800/0x19a47956376b61e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b61de expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.322779:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909340030800, rc 0) 00000100:00100000:3.0:1787582984.322961:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435785600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 541us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582984.322969:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787582984.323096:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435785600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582984.323111:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582984.323120:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582984.323181:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435785728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582984.323209:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582984.323275:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.323358:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435785728 00000100:00100000:1.0:1787582984.323370:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435785728 00000100:00100000:1.0:1787582984.323429:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787582984.323437:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435785728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.323988:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435785728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 549us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.323996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787582984.324051:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435785728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582984.324079:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435785856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582984.324118:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582984.324260:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.324291:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435785856 00000100:00100000:3.0:1787582984.324295:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435785856 00000100:00100000:2.0:1787582984.324326:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787582984.324335:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435785856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582984.324432:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435785856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582984.324438:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787582984.324612:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435785856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582984.325093:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10363:1874416435785984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582984.325136:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582984.325166:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092464736c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582984.325211:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435785984 00000100:00100000:2.0:1787582984.325216:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435785984 00000100:00100000:2.0:1787582984.325238:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787582984.325245:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:10363:x1874416435785984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582984.325328:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:10363:x1874416435785984:12345-0@lo:502:llog_process_th.0 Request processed in 82us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582984.325335:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787582984.325413:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10363:1874416435785984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787582984.325439:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582984.325458:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582984.325460:0:10363:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787582984.325468:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787582984.325487:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10363:1874416435786112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582984.325526:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582984.325841:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092464736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.326524:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435786112 00000100:00100000:1.0:1787582984.326539:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435786112 00000100:00100000:1.0:1787582984.326589:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787582984.326597:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:10363:x1874416435786112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582984.329391:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:10363:x1874416435786112:12345-0@lo:502:llog_process_th.0 Request processed in 2786us (3855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.329405:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787582984.329786:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10363:1874416435786112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787582984.329819:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582984.329826:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582984.329828:0:10363:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787582984.329833:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1787582984.337780:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1787582984.337820:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787582984.337832:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.337885:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582984.337897:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787582984.337918:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff909348740800 from 48 10000000:01000000:2.0:1787582984.337922:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787582984.337961:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.337970:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.337980:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582984.338007:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435786240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787582984.338067:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582984.338115:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7480 going to sleep for 11 seconds 00000100:00100000:0.0:1787582984.338298:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435786240 00000100:00100000:0.0:1787582984.338306:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435786240 00000100:00100000:0.0:1787582984.338362:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787582984.338372:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435786240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582984.338384:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582984.338397:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713f200/0x19a47956376b61f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b61ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582984.338431:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713f200/0x19a47956376b61f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b61ec expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582984.338441:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713f200/0x19a47956376b61f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b61ec expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582984.338479:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f200, rc 0) 00000100:00100000:0.0:1787582984.338539:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435786240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582984.338545:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787582984.338618:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435786240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582984.338641:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.338650:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582984.338712:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435786368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.338738:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582984.338769:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582984.339071:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435786368 00000100:00100000:0.0:1787582984.339076:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435786368 00000100:00100000:0.0:1787582984.339107:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787582984.339114:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435786368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582984.339238:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435786368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582984.339245:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787582984.339319:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435786368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.339362:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435786496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.339402:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582984.339429:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.339442:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435786496 00000100:00100000:3.0:1787582984.339446:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435786496 00000100:00100000:3.0:1787582984.339465:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787582984.339470:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435786496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.339974:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435786496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 502us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582984.339989:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787582984.340036:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435786496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.342515:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10364:1874416435786624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582984.342604:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582984.342709:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435786624 00000100:00100000:2.0:1787582984.342715:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435786624 00000100:00100000:2.0:1787582984.342756:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787582984.342765:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:10364:x1874416435786624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582984.343748:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:10364:x1874416435786624:12345-0@lo:502:llog_process_th.0 Request processed in 978us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582984.343759:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787582984.343842:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936eea66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.344189:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10364:1874416435786624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582984.344270:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10364:1874416435786752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582984.344314:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582984.344334:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582984.344455:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435786752 00000100:00100000:2.0:1787582984.344463:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435786752 00000100:00100000:2.0:1787582984.344782:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787582984.344792:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:10364:x1874416435786752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582984.345076:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:10364:x1874416435786752:12345-0@lo:502:llog_process_th.0 Request processed in 285us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582984.345083:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787582984.345187:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10364:1874416435786752:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787582984.345211:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787582984.345428:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787582984.345448:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787582984.345458:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.345470:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582984.345480:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787582984.345483:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1787582984.345486:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787582984.345516:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.345524:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.349436:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582984.349476:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435786880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787582984.349573:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582984.349761:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909346bea000 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.350061:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435786880 00000100:00100000:3.0:1787582984.350068:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435786880 00000100:00100000:3.0:1787582984.350124:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787582984.350133:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435786880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582984.350147:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582984.350163:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909340031800/0x19a47956376b6201 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b61fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.350186:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909340031800/0x19a47956376b6201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b61fa expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.350196:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909340031800/0x19a47956376b6201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b61fa expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.350226:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909340031800, rc 0) 00000100:00100000:3.0:1787582984.350265:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435786880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582984.350272:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787582984.350481:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435786880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582984.350505:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.350515:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582984.350606:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435787008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582984.351099:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582984.351133:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909346bea000 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.351179:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435787008 00000100:00100000:1.0:1787582984.351184:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435787008 00000100:00100000:1.0:1787582984.351220:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787582984.351228:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435787008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.351364:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435787008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.351371:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787582984.351490:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435787008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582984.351709:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435787136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582984.351753:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582984.351776:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909346bea000 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.352091:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435787136 00000100:00100000:1.0:1787582984.352096:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435787136 00000100:00100000:1.0:1787582984.352121:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787582984.352128:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435787136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582984.352229:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435787136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.352244:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787582984.352313:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435787136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582984.352824:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10365:1874416435787264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582984.352894:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582984.352923:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff909346beab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787582984.352994:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435787264 00000100:00100000:3.0:1787582984.352999:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435787264 00000100:00100000:3.0:1787582984.353028:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787582984.353035:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:10365:x1874416435787264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582984.353121:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:10365:x1874416435787264:12345-0@lo:502:llog_process_th.0 Request processed in 86us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582984.353128:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787582984.353247:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10365:1874416435787264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787582984.353270:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582984.353279:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582984.353281:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787582984.353286:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787582984.353305:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10365:1874416435787392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582984.353334:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582984.353365:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff909346beab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787582984.353403:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435787392 00000100:00100000:1.0:1787582984.353408:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435787392 00000100:00100000:1.0:1787582984.353437:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787582984.353444:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:10365:x1874416435787392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582984.353519:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:10365:x1874416435787392:12345-0@lo:502:llog_process_th.0 Request processed in 74us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582984.353525:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787582984.353776:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10365:1874416435787392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787582984.353794:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582984.353799:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582984.353800:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787582984.353803:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787582984.353977:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1787582984.353998:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787582984.354009:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.354019:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582984.354028:0:6525:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787582984.354031:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff909343e199b8 from 1 10000000:01000000:3.0:1787582984.354035:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787582984.354058:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded200/0x19a47956376b6208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.354076:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344ded200/0x19a47956376b6208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.354086:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344ded200/0x19a47956376b6208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582984.354098:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435787520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.354125:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582984.354155:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582984.354713:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435787520 00000100:00100000:2.0:1787582984.354726:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435787520 00000100:00100000:2.0:1787582984.354770:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787582984.354778:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435787520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582984.354788:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582984.354800:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924770a400/0x19a47956376b620f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6208 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.354822:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924770a400/0x19a47956376b620f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6208 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.354833:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924770a400/0x19a47956376b620f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6208 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.354842:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a400, rc 0) 00000100:00100000:2.0:1787582984.354919:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435787520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582984.354925:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787582984.355108:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435787520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582984.355122:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344ded200/0x19a47956376b6208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b620f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.355131:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344ded200/0x19a47956376b6208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b620f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582984.355207:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435787648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582984.355234:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582984.355263:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582984.355341:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435787648 00000100:00100000:2.0:1787582984.355355:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435787648 00000100:00100000:2.0:1787582984.355421:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787582984.355429:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435787648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582984.355505:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435787648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (269us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787582984.355512:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787582984.355577:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435787648:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787582984.355601:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787582984.355608:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded200/0x19a47956376b6208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b620f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582984.355616:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344ded200/0x19a47956376b6208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b620f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582984.590365:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582985.166221:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435788032:0@lo:400:kworker.0 00000100:00100000:0.0:1787582985.166295:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582985.166362:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435788544:0@lo:400:kworker.0 00000100:00100000:0.0:1787582985.166387:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582985.166404:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435789056:0@lo:400:kworker.0 00000100:00100000:0.0:1787582985.166449:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582985.166476:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787582985.166481:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435788160:0@lo:400:kworker.0 00000100:00100000:0.0:1787582985.166503:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582985.166518:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435788672:0@lo:400:kworker.0 00000100:00100000:0.0:1787582985.166540:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582985.166566:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435789184:0@lo:400:kworker.0 00000100:00100000:0.0:1787582985.166585:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582985.166629:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435788672 00000100:00100000:0.0:1787582985.166647:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435788672 00000100:00100000:0.0:1787582985.166688:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435789184 00000100:00100000:0.0:1787582985.166692:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435789184 00000100:00100000:0.0:1787582985.166721:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787582985.166730:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435788672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582985.166782:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435788672:12345-0@lo:400:kworker.0 Request processed in 52us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582985.166790:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787582985.166811:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787582985.166818:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435789184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.166830:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435787904:0@lo:400:kworker.0 00000100:00100000:1.0:1787582985.166905:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435787776:0@lo:400:kworker.0 00000100:00100000:0.0:1787582985.166994:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435789184:12345-0@lo:400:kworker.0 Request processed in 175us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582985.167001:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787582985.167019:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787582985.167131:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435788032 00000100:00100000:3.0:1787582985.167136:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435788032 00000100:00100000:3.0:1787582985.167165:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787582985.167172:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435788032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.177522:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582985.177583:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435788416:0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.178067:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582985.178083:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435788928:0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.178102:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582985.178122:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435789440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582985.178141:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582985.178187:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435788544 00000100:00100000:2.0:1787582985.178194:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435788544 00000100:00100000:2.0:1787582985.178236:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435789056 00000100:00100000:2.0:1787582985.178239:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435789056 00000100:00100000:2.0:1787582985.178250:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435788160 00000100:00100000:2.0:1787582985.178253:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435788160 00000100:00100000:2.0:1787582985.178261:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435787904 00000100:00100000:2.0:1787582985.178263:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435787904 00000100:00100000:2.0:1787582985.178271:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435788416 00000100:00100000:2.0:1787582985.178273:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435788416 00000100:00100000:2.0:1787582985.178281:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435788928 00000100:00100000:2.0:1787582985.178283:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435788928 00000100:00100000:2.0:1787582985.178308:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787582985.178316:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435788544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.178373:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435788544:12345-0@lo:400:kworker.0 Request processed in 57us (11985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582985.178380:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787582985.178395:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787582985.178400:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435789056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.178425:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435789056:12345-0@lo:400:kworker.0 Request processed in 25us (11976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582985.178430:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787582985.178440:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787582985.178454:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435788160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.178478:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435788160:12345-0@lo:400:kworker.0 Request processed in 25us (11975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582985.178484:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787582985.178493:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787582985.178499:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435787904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.178528:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435787904:12345-0@lo:400:kworker.0 Request processed in 29us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582985.178533:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787582985.178544:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787582985.178550:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435788416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.178575:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435788416:12345-0@lo:400:kworker.0 Request processed in 25us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582985.178580:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787582985.178591:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787582985.178596:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435788928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.178812:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435788928:12345-0@lo:400:kworker.0 Request processed in 215us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582985.178818:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787582985.178921:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435789440 00000100:00100000:2.0:1787582985.178926:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435789440 00000100:00100000:1.0:1787582985.178945:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582985.178960:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787582985.178968:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435789440:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582985.178987:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435788288:0@lo:400:kworker.0 00002000:00000024:2.0:1787582985.178991:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787582985.179020:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582985.179037:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435789440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582985.179048:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435788800:0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.179055:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787582985.179079:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787582985.179085:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582985.179093:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435789568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787582985.179109:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435789312:0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.179126:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582985.179152:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582985.179156:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435788288 00000100:00100000:2.0:1787582985.179162:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435788288 00000100:00100000:2.0:1787582985.179183:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435789568 00000100:00100000:2.0:1787582985.179185:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435789568 00000100:00100000:1.0:1787582985.179200:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787582985.179211:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435788288:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787582985.179218:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787582985.179224:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787582985.179226:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787582985.179258:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435788288:12345-0@lo:400:kworker.0 Request processed in 50us (237us total) trans 0 rc 0/0 00010000:00080000:2.0:1787582985.179261:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092477dfb80 x1874416435789440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582985.179271:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787582985.179291:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435789440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582985.179291:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787582985.179300:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435789568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787582985.179322:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787582985.179325:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435787904:0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.179348:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435788416:0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.179362:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435788928:0@lo:400:kworker.0 00000100:00100000:1.0:1787582985.179388:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435789568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582985.179395:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787582985.179416:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435788800 00000100:00100000:1.0:1787582985.179421:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435788800 00000100:00100000:2.0:1787582985.179434:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435789312 00000100:00100000:2.0:1787582985.179440:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435789312 00000100:00100000:1.0:1787582985.179453:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787582985.179464:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435788800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.179469:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787582985.179479:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435789312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582985.179503:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435788800:12345-0@lo:400:kworker.0 Request processed in 42us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582985.179510:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787582985.179523:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435789312:12345-0@lo:400:kworker.0 Request processed in 46us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582985.179531:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787582985.179550:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435789568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787582985.179573:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435787776 00000100:00100000:2.0:1787582985.179583:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435787776 00000100:00100000:1.0:1787582985.179586:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435788288:0@lo:400:kworker.0 00010000:00080000:1.0:1787582985.179600:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245ae5500 x1874416435788800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582985.179610:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435788800:0@lo:400:kworker.0 00010000:00080000:1.0:1787582985.179621:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245ae7480 x1874416435789312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582985.179631:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435789312:0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.185147:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787582985.185190:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435787776:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787582985.185743:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245ae4000 x1874416435788672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582985.185760:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435788672:0@lo:400:kworker.0 00010000:00080000:0.0:1787582985.185776:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245ae7b80 x1874416435789184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582985.185783:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435789184:0@lo:400:kworker.0 00010000:00080000:0.0:1787582985.185794:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245ae5f80 x1874416435788544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582985.185803:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435788544:0@lo:400:kworker.0 00010000:00080000:0.0:1787582985.185814:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245ae6d80 x1874416435789056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582985.185841:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435789056:0@lo:400:kworker.0 00000100:00100000:0.0:1787582985.185907:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435788160:0@lo:400:kworker.0 00000100:00100000:2.0:1787582985.189870:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435787776:12345-0@lo:400:kworker.0 Request processed in 4678us (10903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582985.189886:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787582985.191782:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435787776:0@lo:400:kworker.0 00000100:00100000:3.0:1787582985.193610:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435788032:12345-0@lo:400:kworker.0 Request processed in 26430us (27306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582985.193624:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787582985.193831:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435788032:0@lo:400:kworker.0 00000100:00100000:3.0:1787582985.552091:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582985.552214:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413709952 00000100:00100000:2.0:1787582985.552224:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413709952 00000100:00100000:2.0:1787582985.552284:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:2.0:1787582985.552295:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+8:6178:x1874416413709952:12345-192.168.203.11@tcp:101: 00010000:00010000:2.0:1787582985.552312:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582985.552329:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924770be00/0x19a47956376b6216 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4096 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582985.552367:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924770be00/0x19a47956376b6216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4096 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582985.552378:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924770be00/0x19a47956376b6216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4096 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582985.552387:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770be00, rc 0) 00000100:00100000:2.0:1787582985.552445:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+9:6178:x1874416413709952:12345-192.168.203.11@tcp:101: Request processed in 152us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582985.552452:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:2.0:1787582985.555231:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582985.555328:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413710080 00000100:00100000:1.0:1787582985.555349:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413710080 00000100:00100000:1.0:1787582985.555405:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 244 00000100:00100000:1.0:1787582985.555415:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+9:6178:x1874416413710080:12345-192.168.203.11@tcp:501: 00000100:00100000:1.0:1787582985.555586:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+9:6178:x1874416413710080:12345-192.168.203.11@tcp:501: Request processed in 172us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582985.555610:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 244 00000100:00100000:0.0:1787582985.557654:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582985.557824:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413710208 00000100:00100000:1.0:1787582985.557834:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413710208 00000100:00100000:1.0:1787582985.557921:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:1.0:1787582985.557933:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+9:6178:x1874416413710208:12345-192.168.203.11@tcp:503: 00000100:00100000:1.0:1787582985.558083:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+9:6178:x1874416413710208:12345-192.168.203.11@tcp:503: Request processed in 152us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582985.558091:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:3.0:1787582985.561358:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582985.561535:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413710336 00000100:00100000:1.0:1787582985.561544:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413710336 00000100:00100000:1.0:1787582985.561599:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:1.0:1787582985.561609:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+9:6666:x1874416413710336:12345-192.168.203.11@tcp:502: 00000100:00100000:1.0:1787582985.561784:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+9:6666:x1874416413710336:12345-192.168.203.11@tcp:502: Request processed in 175us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582985.561792:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:0.0:1787582985.565523:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582985.569757:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413710464 00000100:00100000:2.0:1787582985.569773:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413710464 00000100:00100000:2.0:1787582985.569902:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 247 00000100:00100000:2.0:1787582985.569951:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+9:6666:x1874416413710464:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787582985.570108:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+9:6666:x1874416413710464:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 180us (4594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582985.570116:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 247 00000100:00100000:0.0:1787582985.573761:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582985.574033:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413710592 00000100:00100000:3.0:1787582985.574043:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413710592 00000100:00100000:3.0:1787582985.574101:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:3.0:1787582985.574112:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+9:6178:x1874416413710592:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582985.574128:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582985.574146:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344ded000/0x19a47956376b621d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c409d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582985.574173:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344ded000/0x19a47956376b621d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c409d expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582985.574183:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344ded000/0x19a47956376b621d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c409d expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582985.574191:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344ded000, rc 0) 00000100:00100000:3.0:1787582985.574248:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:6178:x1874416413710592:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 137us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582985.574271:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:3.0:1787582985.576287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582985.576394:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413710720 00000100:00100000:1.0:1787582985.576402:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413710720 00000100:00100000:1.0:1787582985.576454:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:1.0:1787582985.576463:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:6178:x1874416413710720:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582985.576580:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:6178:x1874416413710720:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 117us (300us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787582985.576586:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 249 00010000:00010000:2.0:1787582985.614532:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582985.678119:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435789696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787582985.678204:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582985.678492:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435789696 00000100:00100000:2.0:1787582985.678500:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435789696 00000100:00100000:2.0:1787582985.678552:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787582985.678562:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435789696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787582985.678584:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582985.678813:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435789696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 251us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582985.678821:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787582985.680119:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f14c000 x1874416435789696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582985.680212:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435789696:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787582986.638155:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787582987.493140:0:10403:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7f90d340 20000000:00000080:1.0:1787582987.493158:0:10403:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90936f3bd000 uarg=0000000000000000 20000000:01000000:1.0:1787582987.493204:0:10403:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787582987.493212:0:10403:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787582987.493217:0:10403:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787582987.493733:0:10404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787582987.494124:0:10403:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787582987.499036:0:10403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787582987.499070:0:10403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787582987.499083:0:10403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787582987.499097:0:10403:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787582987.499114:0:10403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.499132:0:10403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367f400/0x19a47956376b5ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5eb9 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.499140:0:10403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909341480a00/0x19a47956376b5ece lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5ec7 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.499148:0:10403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909340031a00/0x19a47956376b5f22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b5f1b expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.499154:0:10403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909341480200/0x19a47956376b6048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6041 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.499163:0:10403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924770a000/0x19a47956376b6160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c405e expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.499185:0:10403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.499221:0:10403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924770a000/0x19a47956376b6160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c405e expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.499235:0:10403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90924770a000/0x19a47956376b6160 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c405e expref: 9 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582987.499251:0:10403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1874416435789824:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787582987.499366:0:10403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909341480200/0x19a47956376b6048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b6041 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.499375:0:10403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909341480200/0x19a47956376b6048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b6041 expref: 23 pid: 6520 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582987.499384:0:10403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1874416435789952:0@lo:104: 00000100:00100000:0.0:1787582987.499422:0:10403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787582987.499455:0:10403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909340031a00/0x19a47956376b5f22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5f1b expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.499463:0:10403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909340031a00/0x19a47956376b5f22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5f1b expref: 23 pid: 6520 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582987.499472:0:10403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1874416435790080:0@lo:104: 00000100:00100000:0.0:1787582987.499495:0:10403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787582987.499515:0:10403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909341480a00/0x19a47956376b5ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5ec7 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.499533:0:10403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909341480a00/0x19a47956376b5ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5ec7 expref: 23 pid: 6522 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582987.499553:0:10403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1874416435790208:0@lo:104: 00010000:00010000:0.0:1787582987.499581:0:10403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367f400/0x19a47956376b5ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b5eb9 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.499589:0:10403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90936367f400/0x19a47956376b5ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b5eb9 expref: 23 pid: 6522 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582987.499597:0:10403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1874416435790336:0@lo:104: 00000100:00100000:0.0:1787582987.499621:0:10403:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582987.499977:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787582987.499996:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582987.500009:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582987.500017:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435789952 00000100:00100000:2.0:1787582987.500024:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435789952 00000100:00100000:2.0:1787582987.500058:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435790080 00000100:00100000:2.0:1787582987.500060:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435790080 00000100:00100000:2.0:1787582987.500068:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435790208 00000100:00100000:2.0:1787582987.500070:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435790208 00000100:00100000:2.0:1787582987.500077:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435790336 00000100:00100000:2.0:1787582987.500078:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435790336 00000100:00100000:2.0:1787582987.500089:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787582987.500097:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+6:10403:x1874416435789952:12345-0@lo:104: 00010000:00010000:2.0:1787582987.500109:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b6048 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.500170:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787582987.500176:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+6:10403:x1874416435789952:12345-0@lo:104: Request processed in 79us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582987.500183:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787582987.500198:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787582987.500203:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:10403:x1874416435790080:12345-0@lo:104: 00010000:00010000:2.0:1787582987.500210:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5f22 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.500236:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787582987.500240:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:10403:x1874416435790080:12345-0@lo:104: Request processed in 37us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582987.500245:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787582987.500271:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787582987.500276:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:10403:x1874416435790208:12345-0@lo:104: 00010000:00010000:2.0:1787582987.500282:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5ece expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582987.500372:0:10403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1874416435789952:0@lo:104: 00000100:00100000:0.0:1787582987.500379:0:10403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1874416435790080:0@lo:104: 00000100:00100000:0.0:1787582987.500385:0:10403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1874416435790208:0@lo:104: 00000100:00100000:0.0:1787582987.503585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582987.503743:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413710848 00000100:00100000:0.0:1787582987.503751:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413710848 00010000:00010000:0.0:1787582987.503789:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924770a000/0x19a47956376b6160 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c405e expref: 10 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582987.503823:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:0.0:1787582987.503833:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa77711a-a697-4098-9892-32db59b6905c+10:2406:x1874416413710848:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787582987.503883:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582987.503891:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924770a000/0x19a47956376b6160 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c405e expref: 10 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.503926:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924770a000/0x19a47956376b6160 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c405e expref: 10 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.504079:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582987.504131:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa77711a-a697-4098-9892-32db59b6905c+10:2406:x1874416413710848:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 299us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582987.504140:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00010000:00010000:3.0:1787582987.505270:0:10403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924770a000/0x19a47956376b6160 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c405e expref: 9 pid: 6521 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582987.505290:0:10403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1874416435789824:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787582987.505527:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787582987.505548:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:10403:x1874416435790208:12345-0@lo:104: Request processed in 5259us (5539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582987.505559:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787582987.505585:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787582987.505598:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:10403:x1874416435790336:12345-0@lo:104: 00010000:00010000:2.0:1787582987.505620:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b5eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5ec0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.505701:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787582987.505706:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:10403:x1874416435790336:12345-0@lo:104: Request processed in 115us (5696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582987.505712:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1787582987.505733:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787582987.505739:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b6048 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.505746:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787582987.505751:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b6048 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.505759:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b6048 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582987.505767:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b6048 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582987.505773:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787582987.506485:0:10403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1874416435790336:0@lo:104: 00010000:00010000:0.0:1787582987.506521:0:10403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582987.508692:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787582987.508706:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5f22 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582987.508717:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787582987.508722:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5f22 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582987.508731:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5f22 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582987.508738:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5f22 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582987.508743:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787582987.508867:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787582987.509251:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6048 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.509261:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582987.509285:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6048 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.509293:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909341480000/0x19a47956376b6041 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6048 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.509344:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582987.509348:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b5eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5ec0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.509354:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787582987.509357:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b5eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5ec0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.509364:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b5eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5ec0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582987.509371:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b5eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5ec0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582987.509376:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787582987.509487:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f22 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582987.509493:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582987.509500:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f22 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582987.509517:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b5f1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5f22 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582987.509528:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582987.509530:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582987.509532:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582987.509561:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435790464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582987.509759:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582987.509883:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582987.509890:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435790592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582987.509915:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582987.510071:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b5eb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5ec0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.510078:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582987.510096:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b5eb9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5ec0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.510103:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b5eb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5ec0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.510114:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582987.510116:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582987.510118:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582987.510132:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435790720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787582987.510371:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582987.510374:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582987.510375:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582987.510407:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b5ece expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.510416:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1787582987.510420:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b5ece expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.510427:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b5ece expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582987.510434:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b5ece expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582987.510439:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787582987.510466:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5ece expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.510472:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582987.510486:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5ece expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.510504:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90936367f800/0x19a47956376b5ec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b5ece expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.510519:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582987.510521:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582987.510522:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582987.510531:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435790848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787582987.510575:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582987.511246:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582987.511275:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435790464 00000100:00100000:3.0:1787582987.511282:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435790464 00010000:00010000:3.0:1787582987.511312:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909341480200/0x19a47956376b6048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b6041 expref: 24 pid: 6520 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582987.511345:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435790592 00000100:00100000:3.0:1787582987.511349:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435790592 00010000:00010000:3.0:1787582987.511361:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909340031a00/0x19a47956376b5f22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5f1b expref: 25 pid: 6520 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582987.511371:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435790848 00000100:00100000:3.0:1787582987.511374:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435790848 00010000:00010000:3.0:1787582987.511384:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909341480a00/0x19a47956376b5ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5ec7 expref: 26 pid: 6522 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582987.511394:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435790720 00000100:00100000:3.0:1787582987.511397:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435790720 00010000:00010000:3.0:1787582987.511406:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367f400/0x19a47956376b5ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5eb9 expref: 27 pid: 6522 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582987.511419:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787582987.511436:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+27:3653:x1874416435790464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582987.511449:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582987.511455:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909341480200/0x19a47956376b6048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b6041 expref: 27 pid: 6520 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.511466:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909341480200/0x19a47956376b6048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b6041 expref: 27 pid: 6520 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.511480:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909341480200/0x19a47956376b6048 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b6041 expref: 27 pid: 6520 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.511493:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582987.511532:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+26:3653:x1874416435790464:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582987.511678:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787582987.511695:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787582987.511702:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+25:3653:x1874416435790592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582987.511710:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582987.511714:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909340031a00/0x19a47956376b5f22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5f1b expref: 25 pid: 6520 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.511722:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909340031a00/0x19a47956376b5f22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5f1b expref: 25 pid: 6520 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.511731:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909340031a00/0x19a47956376b5f22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5f1b expref: 25 pid: 6520 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.511740:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582987.511765:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435790592:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582987.511777:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787582987.511790:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787582987.511795:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+23:3656:x1874416435790848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582987.511802:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582987.511806:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909341480a00/0x19a47956376b5ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5ec7 expref: 23 pid: 6522 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.511814:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909341480a00/0x19a47956376b5ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5ec7 expref: 23 pid: 6522 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.511823:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909341480a00/0x19a47956376b5ece lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5ec7 expref: 23 pid: 6522 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.511830:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582987.512011:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+22:3656:x1874416435790848:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582987.512017:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787582987.512030:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787582987.512036:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+21:3655:x1874416435790720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582987.512043:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582987.512048:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367f400/0x19a47956376b5ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b5eb9 expref: 21 pid: 6522 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.512057:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367f400/0x19a47956376b5ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b5eb9 expref: 21 pid: 6522 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.512066:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367f400/0x19a47956376b5ec0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b5eb9 expref: 21 pid: 6522 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.512088:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.512095:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.512110:0:8470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.512118:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.512124:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.512130:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.512135:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fe00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787582987.512139:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.512146:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.512163:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582987.512172:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582987.512198:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+20:3655:x1874416435790720:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582987.512212:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787582987.512267:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435790592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787582987.512276:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435790464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787582987.512298:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435790848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787582987.512313:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435790720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787582987.512439:0:10403:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.512448:0:10403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582987.512455:0:10403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713fe00/0x19a47956376b6224 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582987.665800:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582988.240688:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582988.240713:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435790976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787582988.240782:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582988.240870:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435790976 00000100:00100000:1.0:1787582988.240878:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435790976 00000100:00100000:1.0:1787582988.240921:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787582988.240929:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435790976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787582988.240961:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787582988.241005:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435790976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582988.241013:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787582988.241058:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435790976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787582988.563020:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582988.563057:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582988.563080:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582988.563102:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582988.563145:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582988.563172:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413710976 00000100:00100000:2.0:1787582988.563182:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413710976 00000100:00100000:2.0:1787582988.563242:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:2.0:1787582988.563254:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+9:2405:x1874416413710976:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787582988.563345:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+9:2405:x1874416413710976:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 93us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582988.563353:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:2.0:1787582988.563661:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413711232 00000100:00100000:2.0:1787582988.563666:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413711232 00000100:00100000:2.0:1787582988.563700:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413711104 00000100:00100000:2.0:1787582988.563703:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413711104 00000100:00100000:2.0:1787582988.563724:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:2.0:1787582988.563731:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413711232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787582988.563765:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413711232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582988.563772:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:2.0:1787582988.563783:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:2.0:1787582988.563790:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2405:x1874416413711104:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787582988.563828:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2405:x1874416413711104:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582988.563834:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:2.0:1787582988.563938:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413711488 00000100:00100000:2.0:1787582988.563943:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413711488 00000100:00100000:2.0:1787582988.563970:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413711360 00000100:00100000:2.0:1787582988.563974:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413711360 00000100:00100000:2.0:1787582988.563993:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:2.0:1787582988.563998:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413711488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787582988.564024:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413711488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582988.564030:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:2.0:1787582988.564040:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:2.0:1787582988.564045:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413711360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787582988.564068:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413711360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582988.564074:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00080000:2.0:1787582988.564099:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787582988.564103:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787582988.564105:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787582988.564106:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787582988.687610:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787582988.878412:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787582988.878420:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936db2f000 from 4 10000000:01000000:3.0:1787582988.878425:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787582988.878736:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582988.878749:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582988.878760:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582988.878785:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435791104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787582988.879547:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582988.879614:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787582988.879765:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435791104 00000100:00100000:1.0:1787582988.879773:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435791104 00000100:00100000:1.0:1787582988.879839:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787582988.879874:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435791104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582988.880267:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582988.880285:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367f400/0x19a47956376b6232 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b622b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582988.880321:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367f400/0x19a47956376b6232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b622b expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582988.880333:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367f400/0x19a47956376b6232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b622b expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582988.880341:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367f400, rc 0) 00000100:00100000:1.0:1787582988.880404:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435791104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 532us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582988.880411:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787582988.880816:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435791104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582988.880833:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6232 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582988.881042:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b6232 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582988.881132:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435791232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582988.881169:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582988.881196:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be180 going to sleep for 11 seconds 00000100:00100000:2.0:1787582988.881211:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435791232 00000100:00100000:2.0:1787582988.881215:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435791232 00000100:00100000:2.0:1787582988.881245:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787582988.881252:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093749e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435791232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582988.881373:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093749e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435791232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582988.881379:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787582988.881421:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435791232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582988.881613:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435791360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582988.881652:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582988.881710:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be180 going to sleep for 11 seconds 00000100:00100000:1.0:1787582988.882569:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435791360 00000100:00100000:1.0:1787582988.882577:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435791360 00000100:00100000:1.0:1787582988.882619:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787582988.882627:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093749e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435791360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582988.884320:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093749e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435791360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1679us (2652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582988.884332:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787582988.884581:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435791360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582988.887690:0:10454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10454:1874416435791488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582988.887767:0:10454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582988.887810:0:10454:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0bee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787582988.890166:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435791488 00000100:00100000:3.0:1787582988.890179:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435791488 00000100:00100000:3.0:1787582988.890290:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787582988.890301:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909345379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:10454:x1874416435791488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582988.890510:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909345379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:10454:x1874416435791488:12345-0@lo:502:llog_process_th.0 Request processed in 210us (2743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582988.890529:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787582988.892358:0:10454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10454:1874416435791488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582988.892404:0:10454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582988.892416:0:10454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582988.892418:0:10454:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787582988.892424:0:10454:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90936db2f000 00000020:00000080:1.0:1787582988.892446:0:10454:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787582988.892549:0:10454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10454:1874416435791616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582988.892614:0:10454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582988.892651:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435791616 00000100:00100000:1.0:1787582988.892657:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435791616 00000100:00100000:1.0:1787582988.893042:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787582988.893053:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934537a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:10454:x1874416435791616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582988.893168:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934537a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:10454:x1874416435791616:12345-0@lo:502:llog_process_th.0 Request processed in 118us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582988.893188:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787582988.893241:0:10454:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a1c6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787582988.893254:0:10454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10454:1874416435791616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582988.893273:0:10454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582988.893278:0:10454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582988.893280:0:10454:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787582988.893283:0:10454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787582988.894770:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787582988.894800:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787582988.894812:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6232 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582988.894825:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6232 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582988.894835:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787582988.894839:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936d948800 from 4 10000000:01000000:3.0:1787582988.894841:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787582988.895164:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582988.895173:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582988.895183:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582988.895207:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435791744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787582988.895266:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582988.895309:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787582988.896372:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435791744 00000100:00100000:0.0:1787582988.896383:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435791744 00000100:00100000:0.0:1787582988.896438:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787582988.896447:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937702bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435791744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582988.896461:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582988.896475:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713f800/0x19a47956376b6240 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6239 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582988.896513:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713f800/0x19a47956376b6240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6239 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582988.896522:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713f800/0x19a47956376b6240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6239 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582988.896530:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f800, rc 0) 00000100:00100000:0.0:1787582988.896585:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937702bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435791744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582988.896592:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787582988.896640:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435791744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582988.896655:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6240 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582988.896663:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b6240 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582988.896732:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435791872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582988.896760:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582988.896784:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787582988.896798:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435791872 00000100:00100000:0.0:1787582988.896801:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435791872 00000100:00100000:0.0:1787582988.896825:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787582988.896831:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435791872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582988.896972:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435791872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582988.896988:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787582988.897019:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435791872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582988.897050:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435792000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582988.897087:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582988.897104:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787582988.897113:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435792000 00000100:00100000:0.0:1787582988.897116:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435792000 00000100:00100000:0.0:1787582988.897133:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787582988.897139:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435792000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582988.897208:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435792000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582988.897215:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787582988.897256:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435792000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582988.897437:0:10457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10457:1874416435792128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582988.897469:0:10457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582988.897486:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435792128 00000100:00100000:0.0:1787582988.897490:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435792128 00000100:00100000:0.0:1787582988.897511:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787582988.897517:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937702a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:10457:x1874416435792128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582988.897581:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937702a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:10457:x1874416435792128:12345-0@lo:502:llog_process_th.0 Request processed in 64us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582988.897588:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787582988.897615:0:10457:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7240 going to sleep for 11 seconds 00000100:00100000:0.0:1787582988.897626:0:10457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10457:1874416435792128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787582988.897650:0:10457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582988.897660:0:10457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582988.897663:0:10457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787582988.897669:0:10457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90936d948800 00000020:00000080:0.0:1787582988.897671:0:10457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787582988.897740:0:10457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10457:1874416435792256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582988.897771:0:10457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582988.897790:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435792256 00000100:00100000:0.0:1787582988.897793:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435792256 00000100:00100000:0.0:1787582988.897813:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787582988.897819:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:10457:x1874416435792256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582988.897907:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:10457:x1874416435792256:12345-0@lo:502:llog_process_th.0 Request processed in 87us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582988.897914:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787582988.897945:0:10457:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787582988.897957:0:10457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10457:1874416435792256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787582988.897975:0:10457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582988.897979:0:10457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582988.897980:0:10457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787582988.897984:0:10457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787582988.898033:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787582988.898050:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787582988.898059:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6240 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582988.898068:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6240 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582988.898088:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787582988.898090:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936d90b000 from 4 10000000:01000000:0.0:1787582988.898093:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787582988.898113:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582988.898121:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582988.898129:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582988.898142:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435792384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787582988.898164:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582988.898180:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787582988.898192:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435792384 00000100:00100000:0.0:1787582988.898195:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435792384 00000100:00100000:0.0:1787582988.898217:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787582988.898222:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435792384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582988.898230:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582988.898240:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713f600/0x19a47956376b624e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6247 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582988.898258:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713f600/0x19a47956376b624e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6247 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582988.898267:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713f600/0x19a47956376b624e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6247 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582988.898286:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f600, rc 0) 00000100:00100000:0.0:1787582988.898328:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435792384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582988.898333:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787582988.898364:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435792384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582988.898375:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b624e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582988.898383:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b624e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582988.898420:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435792512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582988.898444:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582988.898455:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787582988.898464:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435792512 00000100:00100000:0.0:1787582988.898467:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435792512 00000100:00100000:0.0:1787582988.898486:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787582988.898492:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435792512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582988.898572:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435792512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582988.898578:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787582988.898607:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435792512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582988.898629:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435792640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582988.898662:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582988.898680:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787582988.898690:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435792640 00000100:00100000:0.0:1787582988.898694:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435792640 00000100:00100000:0.0:1787582988.898711:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787582988.898717:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435792640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582988.898778:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435792640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582988.898784:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787582988.898821:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435792640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582988.900948:0:10458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10458:1874416435792768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582988.901018:0:10458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582988.901063:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435792768 00000100:00100000:2.0:1787582988.901069:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435792768 00000100:00100000:2.0:1787582988.901115:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787582988.901761:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:10458:x1874416435792768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582988.901911:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:10458:x1874416435792768:12345-0@lo:502:llog_process_th.0 Request processed in 155us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582988.901919:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787582988.902050:0:10458:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247cba0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582988.902078:0:10458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10458:1874416435792768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787582988.902110:0:10458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582988.903558:0:10458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582988.903563:0:10458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787582988.903575:0:10458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90936d90b000 00000020:00000080:2.0:1787582988.903578:0:10458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787582988.903777:0:10458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10458:1874416435792896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582988.903837:0:10458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582988.903890:0:10458:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247cba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582988.910633:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435792896 00000100:00100000:0.0:1787582988.910646:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435792896 00000100:00100000:0.0:1787582988.910708:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787582988.910719:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:10458:x1874416435792896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582988.911165:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:10458:x1874416435792896:12345-0@lo:502:llog_process_th.0 Request processed in 380us (7259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582988.911174:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787582988.911825:0:10458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10458:1874416435792896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787582988.914090:0:10458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582988.914109:0:10458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582988.914113:0:10458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787582988.914119:0:10458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787582988.915579:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787582988.915614:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787582988.915626:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b624e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582988.915638:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b624e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582988.915649:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787582988.915652:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff909348740800 from 4 10000000:01000000:2.0:1787582988.915655:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787582988.915760:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582988.915779:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582988.915791:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582988.915817:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435793024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787582988.917321:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582988.918572:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247cbad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582988.918599:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435793024 00000100:00100000:2.0:1787582988.918609:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435793024 00000100:00100000:2.0:1787582988.918778:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787582988.918790:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435793024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582988.918807:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582988.918822:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924770a600/0x19a47956376b625c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6255 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582988.918860:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924770a600/0x19a47956376b625c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6255 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582988.918873:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924770a600/0x19a47956376b625c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6255 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582988.919001:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a600, rc 0) 00000100:00100000:2.0:1787582988.919067:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435793024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 279us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582988.919074:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787582988.919143:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435793024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582988.919158:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b625c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582988.919168:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b625c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582988.919255:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435793152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582988.919286:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582988.919745:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435793152 00000100:00100000:3.0:1787582988.919750:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435793152 00000100:00100000:3.0:1787582988.919784:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787582988.919791:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435793152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582988.920025:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435793152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582988.920032:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787582988.922037:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247cbad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582988.922078:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435793152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582988.922132:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435793280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582988.922203:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582988.922234:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247cbad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582988.922259:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435793280 00000100:00100000:2.0:1787582988.922264:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435793280 00000100:00100000:2.0:1787582988.922297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787582988.922305:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435793280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582988.922743:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435793280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 437us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582988.922751:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787582988.923124:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435793280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582988.925600:0:10461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10461:1874416435793408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582988.925689:0:10461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582988.925734:0:10461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6540 going to sleep for 11 seconds 00000100:00100000:2.0:1787582988.926148:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435793408 00000100:00100000:2.0:1787582988.926155:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435793408 00000100:00100000:2.0:1787582988.926300:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787582988.926323:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:10461:x1874416435793408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582988.926483:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:10461:x1874416435793408:12345-0@lo:502:llog_process_th.0 Request processed in 174us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582988.926495:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787582988.926580:0:10461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10461:1874416435793408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582988.926608:0:10461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582988.926618:0:10461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582988.926620:0:10461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787582988.926627:0:10461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff909348740800 00000020:00000080:1.0:1787582988.926629:0:10461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787582988.926722:0:10461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10461:1874416435793536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582988.926757:0:10461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582988.937105:0:10461:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a1c6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582988.938504:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435793536 00000100:00100000:3.0:1787582988.938516:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435793536 00000100:00100000:3.0:1787582988.938566:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787582988.938574:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:10461:x1874416435793536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582988.938741:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:10461:x1874416435793536:12345-0@lo:502:llog_process_th.0 Request processed in 167us (11983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582988.938750:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787582988.943104:0:10461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:10461:1874416435793536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582988.943152:0:10461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582988.943167:0:10461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582988.943170:0:10461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787582988.943175:0:10461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787582988.952650:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787582988.952691:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787582988.952703:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b625c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582988.952715:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b625c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582989.262295:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582989.262328:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435793664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582989.262390:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582989.262460:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435793664 00000100:00100000:1.0:1787582989.262468:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435793664 00000100:00100000:1.0:1787582989.262518:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787582989.262536:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435793664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787582989.262563:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787582989.262611:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435793664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582989.262618:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787582989.262635:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787582989.262662:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924764aa00 x1874416435793664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582989.262899:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435793664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787582989.268388:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435793792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787582989.268467:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582989.269207:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435793792 00000100:00100000:3.0:1787582989.269217:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435793792 00000100:00100000:3.0:1787582989.269288:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787582989.269299:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435793792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787582989.269330:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787582989.269387:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435793792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582989.269394:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787582989.269451:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092477dd180 x1874416435793792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582989.269483:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435793792:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787582989.269834:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787582989.455799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582989.455956:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413711616 00000100:00100000:3.0:1787582989.455966:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413711616 00000100:00100000:3.0:1787582989.456267:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 271 00000100:00100000:3.0:1787582989.456279:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+9:6178:x1874416413711616:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582989.456295:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582989.456320:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344dede00/0x19a47956376b6263 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c40a4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582989.456349:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344dede00/0x19a47956376b6263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40a4 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582989.456359:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344dede00/0x19a47956376b6263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40a4 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582989.456367:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dede00, rc 0) 00000100:00100000:3.0:1787582989.456424:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:6178:x1874416413711616:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 148us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582989.456431:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 271 00000100:00100000:0.0:1787582989.463740:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582989.463779:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413711744 00000100:00100000:0.0:1787582989.463788:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413711744 00000100:00100000:0.0:1787582989.463830:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 272 00000100:00100000:0.0:1787582989.463840:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:6178:x1874416413711744:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582989.464018:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:6178:x1874416413711744:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 179us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582989.464026:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 272 00000100:00100000:2.0:1787582989.470442:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582989.470511:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413711872 00000100:00100000:3.0:1787582989.470529:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413711872 00000100:00100000:3.0:1787582989.470584:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 273 00000100:00100000:3.0:1787582989.470594:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:6178:x1874416413711872:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582989.470732:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:6178:x1874416413711872:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 139us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582989.470750:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 273 00000100:00100000:3.0:1787582989.479328:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582989.482472:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413712000 00000100:00100000:0.0:1787582989.482485:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413712000 00000100:00100000:0.0:1787582989.482545:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 274 00000100:00100000:0.0:1787582989.482556:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+10:6729:x1874416413712000:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787582989.482713:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+10:6729:x1874416413712000:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 158us (3410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582989.482722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 274 00000100:00100000:3.0:1787582989.491461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787582989.491699:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413712128 00000100:00100000:2.0:1787582989.491709:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413712128 00000100:00100000:2.0:1787582989.492101:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 275 00000100:00100000:2.0:1787582989.492111:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:6729:x1874416413712128:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787582989.492247:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:6729:x1874416413712128:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 137us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582989.492254:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 275 00010000:00010000:2.0:1787582989.714698:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582990.286333:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435794048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582990.286397:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582990.286411:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582990.286415:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435793920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787582990.286677:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435794432:0@lo:400:kworker.0 00000100:00100000:3.0:1787582990.286733:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435794048 00000100:00100000:3.0:1787582990.286740:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435794048 00000100:00100000:3.0:1787582990.286793:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787582990.286804:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435794048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787582990.286831:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582990.287540:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435794560:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.287578:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.287601:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435795072:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.287625:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.287642:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435795584:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.287677:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.287703:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787582990.287709:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435794176:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.287737:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.287760:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435794688:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.287785:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.287805:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435795200:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.287823:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.287878:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435794560 00000100:00100000:2.0:1787582990.287882:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435794560 00000100:00100000:2.0:1787582990.287917:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787582990.287924:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435794560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.287969:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435794560:12345-0@lo:400:kworker.0 Request processed in 45us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.287976:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787582990.288000:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435795072 00000100:00100000:2.0:1787582990.288003:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435795072 00000100:00100000:2.0:1787582990.288026:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435795584 00000100:00100000:2.0:1787582990.288029:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435795584 00000100:00100000:2.0:1787582990.288044:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435795200 00000100:00100000:2.0:1787582990.288046:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435795200 00000100:00100000:2.0:1787582990.288058:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787582990.288064:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435795072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.288378:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435795072:12345-0@lo:400:kworker.0 Request processed in 312us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.288384:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787582990.288399:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787582990.288415:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435795584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.288448:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435795584:12345-0@lo:400:kworker.0 Request processed in 35us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.288453:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787582990.288468:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787582990.288474:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435795200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.288502:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435795200:12345-0@lo:400:kworker.0 Request processed in 28us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.288507:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787582990.288558:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c5500 x1874416435795200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582990.288572:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435795200:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.288584:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435794560:0@lo:400:kworker.0 00010000:00080000:2.0:1787582990.288593:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c4000 x1874416435795072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582990.288601:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435795072:0@lo:400:kworker.0 00010000:00080000:2.0:1787582990.288610:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c5c00 x1874416435795584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582990.288617:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435795584:0@lo:400:kworker.0 00000100:00080000:2.0:1787582990.288732:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787582990.288751:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435794688 00000100:00100000:2.0:1787582990.288755:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435794688 00000100:00100000:2.0:1787582990.288785:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787582990.288792:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435794688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.289047:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435794688:12345-0@lo:400:kworker.0 Request processed in 255us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.289054:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787582990.289085:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435794688:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.289346:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435794176 00000100:00100000:2.0:1787582990.289352:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435794176 00000100:00100000:2.0:1787582990.289379:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787582990.289386:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435794176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.289424:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435794176:12345-0@lo:400:kworker.0 Request processed in 39us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.289430:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787582990.289462:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435794176:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291018:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.291075:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435794944:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291122:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.291145:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435795456:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291183:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.291229:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787582990.291236:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435794304:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291260:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.291277:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435794816:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291297:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.291325:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435795328:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291346:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.291390:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435794944 00000100:00100000:2.0:1787582990.291396:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435794944 00000100:00100000:2.0:1787582990.291435:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435795456 00000100:00100000:2.0:1787582990.291438:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435795456 00000100:00100000:2.0:1787582990.291452:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435794304 00000100:00100000:2.0:1787582990.291453:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435794304 00000100:00100000:2.0:1787582990.291462:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435794816 00000100:00100000:2.0:1787582990.291464:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435794816 00000100:00100000:2.0:1787582990.291473:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435795328 00000100:00100000:2.0:1787582990.291474:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435795328 00000100:00100000:2.0:1787582990.291489:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787582990.291495:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435794944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291544:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435794944:12345-0@lo:400:kworker.0 Request processed in 48us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.291551:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787582990.291567:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787582990.291573:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435795456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291600:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435795456:12345-0@lo:400:kworker.0 Request processed in 28us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.291606:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787582990.291617:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787582990.291623:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435794304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291649:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435794304:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.291655:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787582990.291667:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787582990.291674:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435794816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291699:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435794816:12345-0@lo:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.291712:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787582990.291726:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787582990.291732:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435795328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291761:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435795328:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.291767:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787582990.291791:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787582990.291795:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787582990.291822:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435794304:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291831:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435794816:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.291840:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435795328:0@lo:400:kworker.0 00010000:00080000:2.0:1787582990.291878:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c5f80 x1874416435794944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582990.291888:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435794944:0@lo:400:kworker.0 00010000:00080000:2.0:1787582990.291899:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c6d80 x1874416435795456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582990.291907:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435795456:0@lo:400:kworker.0 00000100:00100000:0.0:1787582990.292467:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435794432 00000100:00100000:0.0:1787582990.292474:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435794432 00000100:00100000:0.0:1787582990.292518:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787582990.292526:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435794432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582990.292578:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435794432:12345-0@lo:400:kworker.0 Request processed in 53us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582990.292584:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787582990.292614:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435794432:0@lo:400:kworker.0 00000100:00100000:2.0:1787582990.292906:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435794048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6104us (6495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.292916:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787582990.293001:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092477dd180 x1874416435794048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582990.293020:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435794048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582990.294062:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582990.294182:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435793920 00000100:00100000:2.0:1787582990.294190:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435793920 00000100:00100000:2.0:1787582990.294294:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787582990.294326:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435793920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787582990.294357:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787582990.294417:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435793920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582990.294423:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787582990.294755:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435793920:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787582990.734023:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582990.798996:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435795712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787582990.799740:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582990.803048:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435795712 00000100:00100000:1.0:1787582990.803068:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435795712 00000100:00100000:0.0:1787582990.803364:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787582990.803385:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435795712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787582990.803416:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787582990.803506:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435795712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (3771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582990.803514:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787582990.806003:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245ae4000 x1874416435795712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582990.806058:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435795712:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787582991.758068:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582992.781949:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582993.360716:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435795840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787582993.360824:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582993.360917:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435795840 00000100:00100000:0.0:1787582993.360924:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435795840 00000100:00100000:0.0:1787582993.360971:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787582993.360980:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435795840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787582993.361012:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787582993.361059:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435795840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582993.361066:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787582993.361366:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435795840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787582993.688731:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582993.688761:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582993.688787:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582993.688804:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582993.688833:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787582993.688925:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413712512 00000100:00100000:0.0:1787582993.688934:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413712512 00000100:00100000:0.0:1787582993.688985:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413712384 00000100:00100000:0.0:1787582993.688987:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413712384 00000100:00100000:0.0:1787582993.689007:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:0.0:1787582993.689016:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413712512:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787582993.689085:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413712512:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 70us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582993.689091:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:0.0:1787582993.689107:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:0.0:1787582993.689112:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413712384:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787582993.689144:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413712384:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582993.689150:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:0.0:1787582993.689169:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413712768 00000100:00100000:0.0:1787582993.689172:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413712768 00000100:00100000:0.0:1787582993.689193:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413712640 00000100:00100000:0.0:1787582993.689196:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413712640 00000100:00100000:0.0:1787582993.689212:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:0.0:1787582993.689217:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413712768:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787582993.689254:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413712768:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 37us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582993.689261:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:0.0:1787582993.689273:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1787582993.689290:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413712640:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787582993.689311:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413712640:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 33us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582993.689316:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00080000:0.0:1787582993.689335:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787582993.689339:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787582993.689341:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787582993.689343:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787582993.689679:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413712256 00000100:00100000:2.0:1787582993.689684:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413712256 00000100:00100000:2.0:1787582993.689777:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 277 00000100:00100000:2.0:1787582993.689785:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:2406:x1874416413712256:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787582993.689827:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:2406:x1874416413712256:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 43us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582993.689833:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 277 00010000:00010000:3.0:1787582993.809110:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787582994.215736:0:10704:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1787582994.390026:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435795968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787582994.390095:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582994.390171:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435795968 00000100:00100000:2.0:1787582994.390178:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435795968 00000100:00100000:2.0:1787582994.390231:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787582994.390242:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435795968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582994.390271:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582994.390321:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435795968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582994.390328:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787582994.390347:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787582994.390370:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247649880 x1874416435795968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582994.390404:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435795968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787582994.392811:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435796096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787582994.392897:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582994.392965:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435796096 00000100:00100000:2.0:1787582994.392973:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435796096 00000100:00100000:2.0:1787582994.393024:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787582994.393033:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435796096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787582994.393053:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582994.393090:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435796096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582994.393095:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787582994.393116:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787582994.393141:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245ae7800 x1874416435796096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582994.393160:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435796096:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787582994.830151:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582995.406261:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435796352:0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.406336:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582995.406392:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435796864:0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.406423:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582995.406447:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435797376:0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.406467:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582995.406495:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787582995.406501:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435796480:0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.406523:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582995.406547:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435796992:0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.406568:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582995.406585:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435797504:0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.406699:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435796224:0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.406733:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582995.406757:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435796736:0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.406777:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582995.406795:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435797248:0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.406815:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582995.406827:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435797760:0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.406870:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582995.406897:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787582995.406903:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435796608:0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.406926:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582995.406935:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435797120:0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.406952:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582995.406969:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435797632:0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.406988:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582995.407023:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435796480 00000100:00100000:2.0:1787582995.407031:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435796480 00000100:00100000:2.0:1787582995.407069:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435796736 00000100:00100000:2.0:1787582995.407072:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435796736 00000100:00100000:2.0:1787582995.407088:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787582995.407095:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435796480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.407140:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435796480:12345-0@lo:400:kworker.0 Request processed in 45us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582995.407146:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787582995.407162:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787582995.407168:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435796736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.407197:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435796736:12345-0@lo:400:kworker.0 Request processed in 29us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582995.407203:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787582995.407222:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435796224 00000100:00100000:2.0:1787582995.407225:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435796224 00000100:00100000:2.0:1787582995.407247:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787582995.407253:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3654:x1874416435796224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.407297:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3654:x1874416435796224:12345-0@lo:400:kworker.0 Request processed in 44us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582995.407311:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787582995.407341:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435797248 00000100:00100000:2.0:1787582995.407344:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435797248 00000100:00100000:2.0:1787582995.407361:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435797760 00000100:00100000:2.0:1787582995.407363:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435797760 00000100:00100000:2.0:1787582995.407380:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435797120 00000100:00100000:2.0:1787582995.407383:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435797120 00000100:00100000:2.0:1787582995.407390:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435797632 00000100:00100000:2.0:1787582995.407392:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435797632 00000100:00100000:2.0:1787582995.407419:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787582995.407424:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937e5a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435797248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.407454:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937e5a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435797248:12345-0@lo:400:kworker.0 Request processed in 29us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582995.407459:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787582995.407574:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787582995.407581:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435797760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.407895:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582995.407931:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435796480:0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.407956:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435796352 00000100:00100000:3.0:1787582995.407959:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435796352 00000100:00100000:3.0:1787582995.407981:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435796864 00000100:00100000:3.0:1787582995.407983:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435796864 00000100:00100000:3.0:1787582995.407994:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435797376 00000100:00100000:3.0:1787582995.407996:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435797376 00000100:00100000:3.0:1787582995.408004:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435796992 00000100:00100000:3.0:1787582995.408006:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435796992 00000100:00100000:3.0:1787582995.408015:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435796608 00000100:00100000:3.0:1787582995.408018:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435796608 00000100:00100000:3.0:1787582995.408026:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435797504 00000100:00100000:3.0:1787582995.408028:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435797504 00000100:00100000:3.0:1787582995.408039:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787582995.408045:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435796352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.408083:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435796352:12345-0@lo:400:kworker.0 Request processed in 37us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582995.408088:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787582995.408100:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787582995.408106:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435796864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.408129:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435796864:12345-0@lo:400:kworker.0 Request processed in 24us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582995.408134:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787582995.408143:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787582995.408159:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435797376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.408187:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435797376:12345-0@lo:400:kworker.0 Request processed in 29us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582995.408192:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787582995.408204:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787582995.408210:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435796992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.408235:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435796992:12345-0@lo:400:kworker.0 Request processed in 25us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582995.408240:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787582995.408250:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787582995.408255:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435796608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.408290:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435796608:12345-0@lo:400:kworker.0 Request processed in 36us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582995.408295:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787582995.408305:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787582995.408310:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435797504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.408333:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435797504:12345-0@lo:400:kworker.0 Request processed in 23us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582995.408338:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787582995.408772:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435797760:12345-0@lo:400:kworker.0 Request processed in 1190us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582995.408780:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787582995.408795:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787582995.408802:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435797120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.408830:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435797120:12345-0@lo:400:kworker.0 Request processed in 29us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582995.408835:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787582995.408865:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787582995.408872:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435797632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.408913:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435797632:12345-0@lo:400:kworker.0 Request processed in 42us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582995.408920:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787582995.408956:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787582995.408960:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787582995.408962:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787582995.408989:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435796608:0@lo:400:kworker.0 00010000:00080000:2.0:1787582995.409003:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092477dd880 x1874416435797120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582995.409014:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435797120:0@lo:400:kworker.0 00010000:00080000:2.0:1787582995.409025:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247c9f800 x1874416435797632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582995.409034:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435797632:0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.409043:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435796224:0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.409054:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435796736:0@lo:400:kworker.0 00010000:00080000:2.0:1787582995.409066:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092477ddc00 x1874416435797248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582995.409073:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435797248:0@lo:400:kworker.0 00010000:00080000:2.0:1787582995.409082:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247c9c380 x1874416435797760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582995.409090:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435797760:0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.410066:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435797888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787582995.410119:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787582995.410155:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092477df800 x1874416435796992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582995.410166:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435796992:0@lo:400:kworker.0 00010000:00080000:3.0:1787582995.410193:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247c9dc00 x1874416435797504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582995.410201:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435797504:0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.410212:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435796352:0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.410223:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435796864:0@lo:400:kworker.0 00000100:00100000:3.0:1787582995.410234:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435797376:0@lo:400:kworker.0 00000100:00100000:2.0:1787582995.410436:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435797888 00000100:00100000:2.0:1787582995.410447:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435797888 00000100:00100000:2.0:1787582995.410498:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787582995.410507:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435797888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582995.410532:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582995.410581:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435797888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582995.410587:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787582995.410885:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247c9f480 x1874416435797888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582995.410902:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435797888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582995.413007:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582995.415798:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435798016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787582995.415882:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582995.415991:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435798016 00000100:00100000:2.0:1787582995.415999:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435798016 00000100:00100000:2.0:1787582995.416051:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787582995.416060:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435798016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787582995.416096:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787582995.416154:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435798016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582995.416161:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787582995.416249:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435798016:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787582995.854328:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582995.918312:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435798144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787582995.918402:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582995.918650:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435798144 00000100:00100000:2.0:1787582995.918659:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435798144 00000100:00100000:2.0:1787582995.918712:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787582995.918721:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435798144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787582995.918742:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582995.918794:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435798144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582995.918800:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787582995.918978:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f2b6d80 x1874416435798144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582995.918999:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435798144:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787582996.889732:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582997.905092:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582998.478230:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435798272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787582998.478310:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582998.478471:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435798272 00000100:00100000:0.0:1787582998.478479:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435798272 00000100:00100000:0.0:1787582998.478530:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787582998.478540:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435798272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787582998.478572:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787582998.478619:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435798272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582998.478626:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787582998.478743:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435798272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787582998.808674:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582998.808721:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582998.808759:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582998.808788:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413713280 00000100:00100000:3.0:1787582998.808798:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413713280 00000100:00100000:3.0:1787582998.808877:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413713408 00000100:00100000:3.0:1787582998.808881:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413713408 00000100:00100000:3.0:1787582998.808907:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1787582998.808917:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2403:x1874416413713280:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:3.0:1787582998.808952:0:8442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6175 00000100:00080000:3.0:1787582998.808963:0:8442:0:(import.c:65:import_set_state_nolock()) ffff90936f230800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787582998.809020:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787582998.809186:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+2:2403:x1874416413713280:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 270us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582998.809212:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1787582998.809229:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1787582998.809236:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2403:x1874416413713408:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:3.0:1787582998.809260:0:8442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b617c 00000100:00080000:3.0:1787582998.809266:0:8442:0:(import.c:65:import_set_state_nolock()) ffff90936f2d5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787582998.809289:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787582998.809361:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+2:2403:x1874416413713408:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 125us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582998.809367:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00080000:3.0:1787582998.809403:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787582998.809406:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787582998.809468:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582998.809588:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582998.810204:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413712896 00000100:00100000:1.0:1787582998.810212:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413712896 00000100:00100000:1.0:1787582998.810261:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 279 00000100:00100000:1.0:1787582998.810270:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:2407:x1874416413712896:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787582998.810313:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:2407:x1874416413712896:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 43us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582998.810319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 279 00000100:00100000:1.0:1787582998.818199:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787582998.818323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787582998.831137:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413713152 00000100:00100000:3.0:1787582998.831151:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413713152 00000100:00100000:3.0:1787582998.831255:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413713024 00000100:00100000:3.0:1787582998.831259:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413713024 00000100:00100000:3.0:1787582998.831293:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:3.0:1787582998.831304:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413713152:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787582998.831387:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413713152:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 85us (13198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582998.831395:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:3.0:1787582998.831412:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:3.0:1787582998.831418:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413713024:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787582998.831441:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413713024:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (13120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582998.831456:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00080000:1.0:1787582998.834888:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787582998.834897:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787582998.925962:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582999.502005:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435798400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787582999.502072:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582999.502128:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582999.502135:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435798528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787582999.502158:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582999.502192:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435798400 00000100:00100000:2.0:1787582999.502199:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435798400 00000100:00100000:2.0:1787582999.502253:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435798528 00000100:00100000:2.0:1787582999.502257:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435798528 00000100:00100000:2.0:1787582999.502276:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787582999.502283:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435798400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787582999.502310:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582999.502353:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435798400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582999.502435:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787582999.502454:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787582999.502461:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435798528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582999.502471:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787582999.502588:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435798528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582999.502595:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787582999.502618:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787582999.502643:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f2b7b80 x1874416435798528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582999.502661:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435798528:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787582999.502683:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f2b7100 x1874416435798400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582999.502693:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435798400:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1787582999.781970:0:10948:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing yml_node 00010000:00010000:1.0:1787582999.953283:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583000.528687:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435798784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583000.528769:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.528831:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583000.528838:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435798656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583000.528879:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.528914:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435798784 00000100:00100000:2.0:1787583000.528921:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435798784 00000100:00100000:2.0:1787583000.528963:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787583000.528973:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435798784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787583000.529003:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787583000.529046:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435798784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.529054:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787583000.529076:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435798656 00000100:00100000:2.0:1787583000.529080:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435798656 00000100:00100000:2.0:1787583000.529108:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787583000.529114:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435798656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787583000.529133:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583000.529162:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435798656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.529168:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1787583000.529203:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247c9ca80 x1874416435798656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583000.529246:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435798656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583000.529263:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435798784:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1787583000.529288:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787583000.529408:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435798912:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.529438:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.529461:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435799424:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.529484:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.529503:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435799936:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.529598:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.529620:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787583000.529625:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435799040:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.529646:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.529663:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435799552:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.529684:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.529700:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435800064:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.529718:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.529740:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435799168:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.529762:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.529778:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435799680:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.529799:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.529814:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435800192:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.529833:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.529883:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787583000.529888:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435799296:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.529912:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.529923:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435799808:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.529941:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583000.529969:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435798912 00000100:00100000:2.0:1787583000.529973:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435798912 00000100:00100000:2.0:1787583000.530012:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787583000.530020:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435798912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.530058:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435798912:12345-0@lo:400:kworker.0 Request processed in 39us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.530064:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787583000.530090:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435799424 00000100:00100000:2.0:1787583000.530094:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435799424 00000100:00100000:2.0:1787583000.530117:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435799936 00000100:00100000:2.0:1787583000.530120:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435799936 00000100:00100000:2.0:1787583000.530131:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435799040 00000100:00100000:2.0:1787583000.530133:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435799040 00000100:00100000:2.0:1787583000.530143:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435799552 00000100:00100000:2.0:1787583000.530145:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435799552 00000100:00100000:2.0:1787583000.530155:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435800064 00000100:00100000:2.0:1787583000.530156:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435800064 00000100:00100000:2.0:1787583000.530165:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435799296 00000100:00100000:2.0:1787583000.530167:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435799296 00000100:00100000:2.0:1787583000.530177:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787583000.530183:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435799424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.530211:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435799424:12345-0@lo:400:kworker.0 Request processed in 29us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.530216:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787583000.530245:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787583000.530251:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435799936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.530280:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435799936:12345-0@lo:400:kworker.0 Request processed in 29us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.530285:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787583000.530297:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787583000.530303:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435799040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.530327:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435799040:12345-0@lo:400:kworker.0 Request processed in 25us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.530333:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787583000.530343:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787583000.530348:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435799552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.530373:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435799552:12345-0@lo:400:kworker.0 Request processed in 26us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.530379:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787583000.530391:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787583000.530397:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435800064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.530420:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435800064:12345-0@lo:400:kworker.0 Request processed in 24us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.530426:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787583000.530437:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787583000.530442:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435799296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.530471:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435799296:12345-0@lo:400:kworker.0 Request processed in 28us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.530476:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787583000.530508:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435799168 00000100:00100000:2.0:1787583000.530511:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435799168 00000100:00100000:2.0:1787583000.534310:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787583000.534329:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435799168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.534420:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435799168:12345-0@lo:400:kworker.0 Request processed in 99us (4656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.534428:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787583000.534456:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435799680 00000100:00100000:2.0:1787583000.534464:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435799680 00000100:00100000:2.0:1787583000.536321:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435800192 00000100:00100000:2.0:1787583000.536333:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435800192 00000100:00100000:2.0:1787583000.536372:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435799808 00000100:00100000:2.0:1787583000.536375:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435799808 00000100:00100000:2.0:1787583000.536392:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787583000.536400:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435799680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.536468:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435799680:12345-0@lo:400:kworker.0 Request processed in 69us (6668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.536474:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787583000.536488:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787583000.536493:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435800192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.536515:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435800192:12345-0@lo:400:kworker.0 Request processed in 22us (6681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.536520:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787583000.536529:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787583000.536534:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435799808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.536553:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435799808:12345-0@lo:400:kworker.0 Request processed in 19us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583000.536574:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787583000.536622:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435799040:0@lo:400:kworker.0 00010000:00080000:2.0:1787583000.536636:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245896300 x1874416435799552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583000.536646:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435799552:0@lo:400:kworker.0 00010000:00080000:2.0:1787583000.536657:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909351693800 x1874416435800064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583000.536665:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435800064:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.536674:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435798912:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.536683:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435799424:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.536693:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435799936:0@lo:400:kworker.0 00000100:00080000:2.0:1787583000.536728:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787583000.536732:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583000.536734:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583000.536749:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435799296:0@lo:400:kworker.0 00010000:00080000:2.0:1787583000.536760:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245894e00 x1874416435799808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583000.536769:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435799808:0@lo:400:kworker.0 00000100:00100000:2.0:1787583000.536778:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435799168:0@lo:400:kworker.0 00010000:00080000:2.0:1787583000.536786:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245894a80 x1874416435799680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583000.536805:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435799680:0@lo:400:kworker.0 00010000:00080000:2.0:1787583000.536816:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092476e1880 x1874416435800192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583000.536824:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435800192:0@lo:400:kworker.0 00010000:00010000:3.0:1787583000.974744:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583001.038811:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787583001.038836:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435800320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583001.038934:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583001.038996:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435800320 00000100:00100000:2.0:1787583001.039003:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435800320 00000100:00100000:2.0:1787583001.039047:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787583001.039056:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435800320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583001.039076:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583001.039119:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435800320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583001.039126:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787583001.039166:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b62300 x1874416435800320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583001.039186:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435800320:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787583001.999970:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583003.021999:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583003.601431:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435800448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787583003.601673:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583003.601768:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435800448 00000100:00100000:2.0:1787583003.601776:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435800448 00000100:00100000:2.0:1787583003.601817:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787583003.601825:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435800448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787583003.601881:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787583003.601928:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435800448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583003.601935:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787583003.601985:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435800448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583003.918202:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583003.918261:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583003.918298:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583003.918327:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413713536 00000100:00100000:3.0:1787583003.918336:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413713536 00000100:00100000:3.0:1787583003.918383:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 281 00000100:00100000:3.0:1787583003.918394:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+10:2407:x1874416413713536:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583003.918463:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+10:2407:x1874416413713536:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 70us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583003.918471:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 281 00000100:00100000:2.0:1787583003.918494:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413713664 00000100:00100000:2.0:1787583003.918499:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413713664 00000100:00100000:3.0:1787583003.918511:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413713792 00000100:00100000:3.0:1787583003.918514:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413713792 00000100:00100000:3.0:1787583003.918543:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:3.0:1787583003.918550:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413713792:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583003.918583:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413713792:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583003.918590:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:3.0:1787583003.918603:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:3.0:1787583003.918609:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413713664:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583003.918633:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413713664:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583003.918639:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00080000:2.0:1787583003.920770:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583003.920779:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787583004.047177:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787583004.472543:0:11131:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00000100:00100000:3.0:1787583004.622240:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435800576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583004.622310:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583004.623296:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435800576 00000100:00100000:3.0:1787583004.623306:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435800576 00000100:00100000:3.0:1787583004.623358:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787583004.624185:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435800576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787583004.624232:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583004.624301:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435800576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583004.624309:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787583004.624338:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787583004.624391:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247c9e680 x1874416435800576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583004.626074:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435800576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583004.631660:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583004.631681:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435800704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583004.631750:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583004.631808:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435800704 00000100:00100000:1.0:1787583004.631815:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435800704 00000100:00100000:1.0:1787583004.631889:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787583004.631898:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435800704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787583004.631930:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583004.631972:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435800704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583004.631979:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787583004.632020:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247648700 x1874416435800704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583004.632039:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435800704:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787583004.632060:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1787583004.636709:0:8437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000020:00000080:1.0:1787583004.636719:0:8437:0:(genops.c:885:class_export_put()) final put ffff90936f235000/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000020:00000080:3.0:1787583004.636801:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f235000/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae for lustre-OST0000 00000020:00000080:3.0:1787583004.636886:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936f230800 for lustre-OST0000 00000001:00100000:1.0:1787583004.639077:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000020:00000080:1.0:1787583004.639087:0:9523:0:(genops.c:885:class_export_put()) final put ffff90936f2d1800/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000020:00000080:3.0:1787583004.639276:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f2d1800/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae for lustre-OST0001 00000020:00000080:3.0:1787583004.639552:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936f2d5800 for lustre-OST0001 00010000:00010000:1.0:1787583005.071303:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583005.646341:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435800832:0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.646411:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583005.646490:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435800832 00000100:00100000:1.0:1787583005.646498:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435800832 00000100:00100000:1.0:1787583005.646539:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787583005.646548:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3654:x1874416435800832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.646596:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3654:x1874416435800832:12345-0@lo:400:kworker.0 Request processed in 49us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583005.646604:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787583005.646649:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435800832:0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.646699:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583005.646705:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435801216:0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.646737:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583005.646765:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435801216 00000100:00100000:1.0:1787583005.646769:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435801216 00000100:00100000:1.0:1787583005.646797:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787583005.646804:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435801216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.646876:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435801216:12345-0@lo:400:kworker.0 Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583005.646883:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787583005.646914:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435801216:0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.646944:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435801344:0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.647047:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583005.647098:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583005.647182:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435801728:0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.647221:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583005.647249:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435801728 00000100:00100000:1.0:1787583005.647253:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435801728 00000100:00100000:1.0:1787583005.647281:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787583005.647288:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435801728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.647324:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435801728:12345-0@lo:400:kworker.0 Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583005.647330:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787583005.647357:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247649880 x1874416435801728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583005.647368:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435801728:0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.647402:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435801856:0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.647431:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583005.647459:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435801856 00000100:00100000:1.0:1787583005.647463:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435801856 00000100:00100000:1.0:1787583005.647485:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787583005.647492:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435801856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.647525:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435801856:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583005.647531:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787583005.647555:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f14d880 x1874416435801856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583005.647564:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435801856:0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.647600:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583005.647607:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435802240:0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.647628:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583005.647647:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435802240 00000100:00100000:1.0:1787583005.647651:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435802240 00000100:00100000:1.0:1787583005.647677:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787583005.647682:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435802240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.647713:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435802240:12345-0@lo:400:kworker.0 Request processed in 30us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583005.647718:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1787583005.647733:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787583005.647751:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f14e300 x1874416435802240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583005.647760:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435802240:0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.647792:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435802368:0@lo:400:kworker.0 00000100:00100000:1.0:1787583005.647838:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583005.647884:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435802368 00000100:00100000:1.0:1787583005.647887:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435802368 00000100:00100000:1.0:1787583005.647911:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787583005.647917:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435802368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583005.649940:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435800960:0@lo:400:kworker.0 00000100:00080000:0.0:1787583005.650114:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583005.650398:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583005.650444:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435801472:0@lo:400:kworker.0 00000100:00100000:3.0:1787583005.650465:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583005.650484:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435801984:0@lo:400:kworker.0 00000100:00100000:3.0:1787583005.650503:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583005.650521:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435802496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583005.650555:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583005.650582:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787583005.650589:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435801088:0@lo:400:kworker.0 00000100:00100000:3.0:1787583005.650623:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583005.650646:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435801600:0@lo:400:kworker.0 00000100:00100000:3.0:1787583005.650667:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583005.650683:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435802112:0@lo:400:kworker.0 00000100:00100000:3.0:1787583005.650700:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583005.650709:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435802624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583005.650731:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583005.650769:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435801344 00000100:00100000:3.0:1787583005.650776:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435801344 00000100:00100000:3.0:1787583005.650808:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435802496 00000100:00100000:3.0:1787583005.650811:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435802496 00000100:00100000:3.0:1787583005.650821:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435801088 00000100:00100000:0.0:1787583005.651329:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435800960 00000100:00100000:0.0:1787583005.651335:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435800960 00000100:00100000:0.0:1787583005.651357:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435801472 00000100:00100000:0.0:1787583005.651360:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435801472 00000100:00100000:0.0:1787583005.651378:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435801984 00000100:00100000:0.0:1787583005.651380:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435801984 00000100:00100000:0.0:1787583005.651392:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435801600 00000100:00100000:0.0:1787583005.651394:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435801600 00000100:00100000:0.0:1787583005.651404:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435802112 00000100:00100000:0.0:1787583005.651406:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435802112 00000100:00100000:0.0:1787583005.651421:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787583005.651429:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435800960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583005.651487:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435800960:12345-0@lo:400:kworker.0 Request processed in 58us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583005.651494:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787583005.651512:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787583005.651518:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435801472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583005.651556:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435801472:12345-0@lo:400:kworker.0 Request processed in 38us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583005.651562:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787583005.651574:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787583005.651579:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435801984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583005.651604:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435801984:12345-0@lo:400:kworker.0 Request processed in 26us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583005.651610:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787583005.651622:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787583005.651627:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435801600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583005.651653:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435801600:12345-0@lo:400:kworker.0 Request processed in 25us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583005.651659:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787583005.651675:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787583005.651682:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435802112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583005.651706:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435802112:12345-0@lo:400:kworker.0 Request processed in 25us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583005.651711:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1787583005.651728:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787583005.651731:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787583005.651799:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435802368:12345-0@lo:400:kworker.0 Request processed in 30us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583005.651809:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787583005.651931:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f14e300 x1874416435802368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583005.652239:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435802368:0@lo:400:kworker.0 00000100:00100000:3.0:1787583005.652609:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435801088 00000100:00100000:3.0:1787583005.652648:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787583005.652655:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874416435801344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583005.652714:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874416435801344:12345-0@lo:400:kworker.0 Request processed in 60us (5667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583005.652720:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787583005.652733:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787583005.652738:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435802496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787583005.652763:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787583005.652791:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435802496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583005.652806:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787583005.652818:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787583005.652835:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435801088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583005.652883:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435801088:12345-0@lo:400:kworker.0 Request processed in 59us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583005.652889:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787583005.652918:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435802624 00000100:00100000:3.0:1787583005.652922:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435802624 00000100:00100000:3.0:1787583005.654528:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787583005.654542:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435802624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787583005.654574:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583005.654632:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435802624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (3899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583005.654640:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787583005.654698:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435801088:0@lo:400:kworker.0 00010000:00080000:3.0:1787583005.654715:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247648e00 x1874416435801600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583005.654725:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435801600:0@lo:400:kworker.0 00010000:00080000:3.0:1787583005.654735:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f14f800 x1874416435802112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583005.654742:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435802112:0@lo:400:kworker.0 00010000:00080000:3.0:1787583005.654751:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247c9ce00 x1874416435802624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583005.654779:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435802624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583005.654793:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435800960:0@lo:400:kworker.0 00000100:00100000:3.0:1787583005.654804:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435801472:0@lo:400:kworker.0 00000100:00100000:3.0:1787583005.654813:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435801984:0@lo:400:kworker.0 00000100:00100000:3.0:1787583005.654825:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435802496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583005.657020:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435801344:0@lo:400:kworker.0 00010000:00010000:3.0:1787583006.096140:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583006.164713:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583006.164748:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435802752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583006.164818:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583006.164976:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435802752 00000100:00100000:2.0:1787583006.164985:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435802752 00000100:00100000:2.0:1787583006.165035:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787583006.165045:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435802752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583006.165066:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583006.165110:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435802752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583006.165117:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787583006.165271:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b63b80 x1874416435802752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583006.165290:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435802752:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787583007.122794:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787583007.275738:0:11229:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00010000:00010000:2.0:1787583008.153521:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583008.718807:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435802880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787583008.718935:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583008.719228:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435802880 00000100:00100000:0.0:1787583008.719236:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435802880 00000100:00100000:0.0:1787583008.719290:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787583008.719299:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435802880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787583008.719334:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787583008.719429:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435802880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583008.719436:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787583008.720421:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435802880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583009.051677:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583009.051778:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583009.051818:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583009.051918:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413713920 00000100:00100000:2.0:1787583009.051928:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413713920 00000100:00100000:2.0:1787583009.052004:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 283 00000100:00100000:2.0:1787583009.052015:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:2404:x1874416413713920:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583009.052085:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:2404:x1874416413713920:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 72us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583009.052108:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 283 00000100:00100000:3.0:1787583009.052498:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413714176 00000100:00100000:3.0:1787583009.052504:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413714176 00000100:00100000:3.0:1787583009.052552:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413714048 00000100:00100000:3.0:1787583009.052556:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413714048 00000100:00100000:3.0:1787583009.052578:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:3.0:1787583009.052586:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413714176:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583009.052623:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413714176:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 37us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583009.052629:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:3.0:1787583009.052641:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:3.0:1787583009.052648:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413714048:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583009.052669:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413714048:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583009.052675:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00080000:2.0:1787583009.052798:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583009.052802:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787583009.167096:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583009.749746:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435803008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787583009.749821:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583009.750193:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435803008 00000100:00100000:2.0:1787583009.750202:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435803008 00000100:00100000:2.0:1787583009.750254:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787583009.750264:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435803008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583009.750297:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583009.750343:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435803008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583009.750351:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1787583009.750372:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787583009.750400:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc43480 x1874416435803008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583009.750421:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435803008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787583009.759197:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435803136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787583009.759265:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583009.759327:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435803136 00000100:00100000:2.0:1787583009.759335:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435803136 00000100:00100000:2.0:1787583009.759385:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787583009.759394:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435803136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787583009.759417:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583009.759479:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435803136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583009.759486:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1787583009.759511:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787583009.759538:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b63b80 x1874416435803136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583009.759558:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435803136:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1787583009.944678:0:11326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:3.0:1787583010.190805:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583010.766435:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787583010.766472:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435803264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583010.766842:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787583010.766876:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435803392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787583010.766957:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583010.767123:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435803392 00000100:00100000:0.0:1787583010.767131:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435803392 00000100:00100000:0.0:1787583010.767198:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787583010.767210:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435803392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787583010.767237:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787583010.767297:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435803392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583010.767315:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787583010.767373:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c4000 x1874416435803392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583010.767392:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435803392:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787583010.767744:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583010.767820:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583010.768050:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435803776:0@lo:400:kworker.0 00000100:00100000:2.0:1787583010.768080:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583010.768098:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435804288:0@lo:400:kworker.0 00000100:00100000:2.0:1787583010.768120:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583010.768135:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435804800:0@lo:400:kworker.0 00000100:00100000:2.0:1787583010.768153:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583010.768192:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787583010.768198:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435803904:0@lo:400:kworker.0 00000100:00100000:2.0:1787583010.768219:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583010.768231:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435804416:0@lo:400:kworker.0 00000100:00100000:2.0:1787583010.768246:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583010.768266:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435804288 00000100:00100000:2.0:1787583010.768270:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435804288 00000100:00100000:2.0:1787583010.768294:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435804800 00000100:00100000:2.0:1787583010.768296:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435804800 00000100:00100000:2.0:1787583010.768321:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435804416 00000100:00100000:2.0:1787583010.768324:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435804416 00000100:00100000:1.0:1787583010.768641:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435803648:0@lo:400:kworker.0 00000100:00100000:1.0:1787583010.768672:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583010.768690:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435804160:0@lo:400:kworker.0 00000100:00100000:1.0:1787583010.768709:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583010.768722:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435804672:0@lo:400:kworker.0 00000100:00100000:1.0:1787583010.768739:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583010.768753:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787583010.768757:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435803520:0@lo:400:kworker.0 00000100:00100000:1.0:1787583010.768777:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583010.768795:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435804032:0@lo:400:kworker.0 00000100:00100000:1.0:1787583010.768813:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583010.768822:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435804544:0@lo:400:kworker.0 00000100:00100000:1.0:1787583010.768839:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583010.768946:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435803904 00000100:00100000:3.0:1787583010.768950:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435803904 00000100:00100000:3.0:1787583010.768972:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435803648 00000100:00100000:3.0:1787583010.768974:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435803648 00000100:00100000:3.0:1787583010.768982:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435804160 00000100:00100000:3.0:1787583010.768984:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435804160 00000100:00100000:3.0:1787583010.768993:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435804672 00000100:00100000:3.0:1787583010.768995:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435804672 00000100:00100000:3.0:1787583010.769003:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435804032 00000100:00100000:3.0:1787583010.769005:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435804032 00000100:00100000:3.0:1787583010.769012:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435804544 00000100:00100000:3.0:1787583010.769014:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435804544 00000100:00100000:3.0:1787583010.769024:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787583010.769033:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435803904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583010.769080:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435803904:12345-0@lo:400:kworker.0 Request processed in 48us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583010.769086:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787583010.769100:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787583010.769106:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435803648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583010.769136:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435803648:12345-0@lo:400:kworker.0 Request processed in 31us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583010.769142:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787583010.769153:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787583010.769169:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435804160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583010.769192:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435804160:12345-0@lo:400:kworker.0 Request processed in 34us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583010.769197:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787583010.769216:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787583010.769221:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435804672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583010.769248:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435804672:12345-0@lo:400:kworker.0 Request processed in 27us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583010.769252:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787583010.769261:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787583010.769265:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435804032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583010.769287:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435804032:12345-0@lo:400:kworker.0 Request processed in 22us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583010.769293:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787583010.769313:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787583010.769319:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435804544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583010.769596:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787583010.769607:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435804288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583010.769697:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435803264 00000100:00100000:0.0:1787583010.769702:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435803264 00000100:00100000:0.0:1787583010.769727:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435803776 00000100:00100000:0.0:1787583010.769729:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435803776 00000100:00100000:0.0:1787583010.769739:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787583010.769744:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435803264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787583010.769767:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787583010.779703:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787583010.779736:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435804800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583010.779917:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435804288:12345-0@lo:400:kworker.0 Request processed in 10311us (11794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583010.779927:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787583010.779960:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787583010.779970:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435804416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583010.780002:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435804416:12345-0@lo:400:kworker.0 Request processed in 35us (11755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583010.780007:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787583010.780077:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435803904:0@lo:400:kworker.0 00010000:00080000:2.0:1787583010.780092:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245897480 x1874416435804416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583010.780101:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435804416:0@lo:400:kworker.0 00010000:00080000:2.0:1787583010.780111:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245896d80 x1874416435804288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583010.780118:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435804288:0@lo:400:kworker.0 00000100:00100000:2.0:1787583010.780212:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435803520 00000100:00100000:2.0:1787583010.780218:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435803520 00000100:00100000:2.0:1787583010.780257:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787583010.780264:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435803520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583010.780297:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435803520:12345-0@lo:400:kworker.0 Request processed in 35us (11519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583010.780315:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787583010.781570:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435804544:12345-0@lo:400:kworker.0 Request processed in 12245us (12724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583010.781582:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787583010.781642:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435803520:0@lo:400:kworker.0 00000100:00100000:3.0:1787583010.781660:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435804032:0@lo:400:kworker.0 00000100:00100000:0.0:1787583010.781670:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435803264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11921us (13846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583010.781675:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435804544:0@lo:400:kworker.0 00000100:00100000:0.0:1787583010.781686:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787583010.781694:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435803648:0@lo:400:kworker.0 00010000:00080000:3.0:1787583010.781711:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245894e00 x1874416435804160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583010.781722:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435804160:0@lo:400:kworker.0 00000100:00100000:0.0:1787583010.781728:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1787583010.781736:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f2b7100 x1874416435804672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583010.781741:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435803776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583010.781765:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435804672:0@lo:400:kworker.0 00000100:00100000:3.0:1787583010.781879:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435803264:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1787583010.781933:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787583010.781938:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787583010.781941:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583010.782045:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435803776:12345-0@lo:400:kworker.0 Request processed in 308us (13962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583010.782053:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787583010.783606:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435803776:0@lo:400:kworker.0 00000100:00100000:1.0:1787583010.795178:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435804800:12345-0@lo:400:kworker.0 Request processed in 15442us (27004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583010.795194:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787583010.796505:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f2b6680 x1874416435804800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583010.796524:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435804800:0@lo:400:kworker.0 00010000:00010000:0.0:1787583011.213956:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583011.278620:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787583011.278654:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435804928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583011.278747:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583011.278822:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435804928 00000100:00100000:2.0:1787583011.278831:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435804928 00000100:00100000:2.0:1787583011.278896:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787583011.278906:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435804928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583011.278928:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583011.278973:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435804928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583011.278986:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787583011.279032:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15f480 x1874416435804928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583011.279052:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435804928:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1787583011.717262:0:11374:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 10:50:08 EDT 2026 00010000:00010000:2.0:1787583012.240361:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583013.263682:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583013.842597:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435805056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583013.842680:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583013.843102:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435805056 00000100:00100000:1.0:1787583013.843111:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435805056 00000100:00100000:1.0:1787583013.843170:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787583013.843181:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435805056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787583013.843233:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787583013.843304:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435805056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583013.843310:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787583013.843358:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435805056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583014.163085:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583014.163131:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583014.163177:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583014.163240:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413714304 00000100:00100000:0.0:1787583014.163250:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413714304 00000100:00100000:0.0:1787583014.163309:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 285 00000100:00100000:0.0:1787583014.163321:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:2404:x1874416413714304:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583014.163384:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:2404:x1874416413714304:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583014.163392:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 285 00000100:00100000:2.0:1787583014.163512:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413714432 00000100:00100000:2.0:1787583014.163516:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413714432 00000100:00100000:2.0:1787583014.163575:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413714560 00000100:00100000:2.0:1787583014.163579:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413714560 00000100:00100000:2.0:1787583014.163603:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:2.0:1787583014.163610:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413714432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583014.163642:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413714432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583014.163648:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:2.0:1787583014.163660:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00100000:2.0:1787583014.163667:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413714560:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583014.163688:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413714560:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583014.163707:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00080000:0.0:1787583014.164174:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787583014.164178:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787583014.285984:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583014.864081:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435805184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787583014.864158:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583014.864311:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435805184 00000100:00100000:0.0:1787583014.864318:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435805184 00000100:00100000:0.0:1787583014.864381:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787583014.864392:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435805184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583014.864421:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787583014.864475:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435805184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583014.864483:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1787583014.864525:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c4000 x1874416435805184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583014.864544:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435805184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583014.864666:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583014.864677:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435805312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583014.864706:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583014.864730:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435805312 00000100:00100000:1.0:1787583014.864734:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435805312 00000100:00100000:1.0:1787583014.864774:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787583014.864781:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435805312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787583014.864792:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583014.864821:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435805312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583014.864828:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787583014.864879:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc41c00 x1874416435805312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583014.864892:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435805312:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787583014.865006:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787583015.312874:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583015.888999:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435805440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583015.889074:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583015.889278:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435805440 00000100:00100000:3.0:1787583015.889287:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435805440 00000100:00100000:3.0:1787583015.889335:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787583015.889344:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435805440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787583015.889375:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787583015.889428:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435805440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583015.889434:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787583015.889518:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435805440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583015.890026:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435805696:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890064:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583015.890107:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435806208:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890141:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583015.890165:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435806720:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890186:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583015.890210:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787583015.890216:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435805568:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890241:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583015.890261:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435806080:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890293:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583015.890307:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435806592:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890322:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583015.890342:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435805696 00000100:00100000:2.0:1787583015.890346:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435805696 00000100:00100000:2.0:1787583015.890367:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435806208 00000100:00100000:2.0:1787583015.890370:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435806208 00000100:00100000:2.0:1787583015.890388:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435806720 00000100:00100000:2.0:1787583015.890390:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435806720 00000100:00100000:2.0:1787583015.890399:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435806080 00000100:00100000:2.0:1787583015.890408:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435806080 00000100:00100000:2.0:1787583015.890423:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435806592 00000100:00100000:2.0:1787583015.890426:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435806592 00000100:00100000:2.0:1787583015.890440:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787583015.890446:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435805696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890487:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435805696:12345-0@lo:400:kworker.0 Request processed in 41us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583015.890494:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787583015.890510:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787583015.890516:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435806208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890543:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435806208:12345-0@lo:400:kworker.0 Request processed in 28us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583015.890549:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787583015.890562:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787583015.890581:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435806720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890609:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435806720:12345-0@lo:400:kworker.0 Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583015.890615:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787583015.890626:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787583015.890631:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435806080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890655:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435806080:12345-0@lo:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583015.890660:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787583015.890670:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787583015.890675:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435806592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890697:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435806592:12345-0@lo:400:kworker.0 Request processed in 22us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583015.890709:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787583015.890731:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435805568 00000100:00100000:2.0:1787583015.890734:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435805568 00000100:00100000:2.0:1787583015.890772:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787583015.890779:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435805568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890809:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435805568:12345-0@lo:400:kworker.0 Request processed in 31us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583015.890815:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:2.0:1787583015.890870:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583015.890874:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787583015.890887:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435805824:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890915:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583015.890933:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435806336:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890955:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583015.890973:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435806848:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.890993:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583015.891012:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787583015.891018:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435805952:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891040:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583015.891056:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435806464:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891076:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583015.891091:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435806976:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891138:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583015.891165:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435806336 00000100:00100000:2.0:1787583015.891169:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435806336 00000100:00100000:2.0:1787583015.891194:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435806848 00000100:00100000:2.0:1787583015.891198:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435806848 00000100:00100000:2.0:1787583015.891215:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435806464 00000100:00100000:2.0:1787583015.891218:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435806464 00000100:00100000:2.0:1787583015.891227:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435806976 00000100:00100000:2.0:1787583015.891229:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435806976 00000100:00100000:2.0:1787583015.891240:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787583015.891246:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435806336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891279:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435806336:12345-0@lo:400:kworker.0 Request processed in 33us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583015.891285:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787583015.891296:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787583015.891303:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435806848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891329:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435806848:12345-0@lo:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583015.891334:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787583015.891344:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787583015.891350:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435806464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891376:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435806464:12345-0@lo:400:kworker.0 Request processed in 26us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583015.891381:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787583015.891391:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787583015.891397:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435806976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891421:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435806976:12345-0@lo:400:kworker.0 Request processed in 24us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583015.891427:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1787583015.891441:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787583015.891479:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c4a80 x1874416435806464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583015.891492:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435806464:0@lo:400:kworker.0 00010000:00080000:2.0:1787583015.891502:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc45880 x1874416435806976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583015.891510:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435806976:0@lo:400:kworker.0 00010000:00080000:2.0:1787583015.891520:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c6300 x1874416435806336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583015.891527:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435806336:0@lo:400:kworker.0 00010000:00080000:2.0:1787583015.891536:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc44e00 x1874416435806848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583015.891544:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435806848:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891575:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435805568:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891585:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435806080:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891595:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435806592:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891605:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435805696:0@lo:400:kworker.0 00010000:00080000:2.0:1787583015.891615:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c5180 x1874416435806208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583015.891622:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435806208:0@lo:400:kworker.0 00010000:00080000:2.0:1787583015.891632:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c7100 x1874416435806720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583015.891654:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435806720:0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891687:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435805952 00000100:00100000:2.0:1787583015.891691:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435805952 00000100:00100000:2.0:1787583015.891715:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787583015.891722:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435805952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583015.891758:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435805952:12345-0@lo:400:kworker.0 Request processed in 37us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583015.891764:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787583015.891791:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435805952:0@lo:400:kworker.0 00000100:00100000:3.0:1787583015.895350:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435805824 00000100:00100000:3.0:1787583015.895360:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435805824 00000100:00100000:3.0:1787583015.895421:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787583015.895432:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435805824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583015.895543:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435805824:12345-0@lo:400:kworker.0 Request processed in 114us (4626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583015.895551:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787583015.895605:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435805824:0@lo:400:kworker.0 00000100:00100000:1.0:1787583015.895839:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435807104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787583015.895903:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583015.896325:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435807104 00000100:00100000:3.0:1787583015.896331:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435807104 00000100:00100000:3.0:1787583015.896372:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787583015.896380:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435807104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787583015.896403:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583015.896454:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435807104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583015.896461:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787583015.897400:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247da5880 x1874416435807104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583015.897422:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435807104:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787583016.336149:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583016.406864:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787583016.406892:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435807232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583016.406964:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583016.407272:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435807232 00000100:00100000:3.0:1787583016.407282:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435807232 00000100:00100000:3.0:1787583016.407342:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787583016.407352:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435807232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787583016.407373:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583016.407434:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435807232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583016.407441:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787583016.407564:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247da5c00 x1874416435807232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583016.407583:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435807232:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787583017.358185:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583018.386506:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583018.959525:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435807360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583018.959600:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583018.968827:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435807360 00000100:00100000:2.0:1787583018.968868:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435807360 00000100:00100000:2.0:1787583018.968935:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787583018.968946:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435807360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787583018.969000:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787583018.969081:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435807360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (9482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583018.969118:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787583018.970531:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435807360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787583019.283935:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583019.283979:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583019.284021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583019.284050:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413714816 00000100:00100000:0.0:1787583019.284059:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413714816 00000100:00100000:0.0:1787583019.284128:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413714944 00000100:00100000:0.0:1787583019.284131:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413714944 00000100:00100000:0.0:1787583019.284155:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:0.0:1787583019.284164:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2405:x1874416413714816:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583019.284230:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2405:x1874416413714816:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583019.284238:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:1.0:1787583019.284358:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:1.0:1787583019.284368:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413714944:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583019.284409:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413714944:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 43us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583019.284414:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:3.0:1787583019.285424:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413714688 00000100:00100000:3.0:1787583019.285435:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413714688 00000100:00100000:3.0:1787583019.285499:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 287 00000100:00100000:3.0:1787583019.286064:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:2405:x1874416413714688:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583019.286148:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:2405:x1874416413714688:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 88us (2168us total) trans 0 rc 0/0 00000100:00080000:0.0:1787583019.286211:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787583019.286217:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787583019.291694:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 287 00010000:00010000:1.0:1787583019.406094:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583019.985246:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435807488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787583019.985321:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583019.985408:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435807616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787583019.985435:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583019.985472:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435807488 00000100:00100000:2.0:1787583019.985479:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435807488 00000100:00100000:2.0:1787583019.985520:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435807616 00000100:00100000:2.0:1787583019.985523:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435807616 00000100:00100000:2.0:1787583019.985539:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787583019.985548:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435807488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787583019.985581:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583019.985624:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435807488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583019.985631:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787583019.985647:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787583019.985653:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435807616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583019.985662:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583019.985689:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435807616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583019.985696:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787583019.985713:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787583019.985737:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc40000 x1874416435807616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583019.985768:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435807616:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787583019.985800:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc44380 x1874416435807488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583019.985812:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435807488:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787583020.431061:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583021.006537:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435807744:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.006609:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583021.006685:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435807744 00000100:00100000:3.0:1787583021.006692:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435807744 00000100:00100000:3.0:1787583021.006742:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787583021.006752:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435807744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.006806:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435807744:12345-0@lo:400:kworker.0 Request processed in 55us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.006813:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787583021.006891:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435807744:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.006937:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435807872:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.006965:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583021.007001:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435807872 00000100:00100000:3.0:1787583021.007005:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435807872 00000100:00100000:3.0:1787583021.007033:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787583021.007041:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435807872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007077:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435807872:12345-0@lo:400:kworker.0 Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.007083:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787583021.007124:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435807872:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007154:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435808000:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007191:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583021.007222:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435808000 00000100:00100000:3.0:1787583021.007226:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435808000 00000100:00100000:3.0:1787583021.007250:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787583021.007257:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435808000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007293:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435808000:12345-0@lo:400:kworker.0 Request processed in 37us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.007299:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787583021.007327:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435808000:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007360:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435808128:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007467:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583021.007497:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435808128 00000100:00100000:3.0:1787583021.007501:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435808128 00000100:00100000:3.0:1787583021.007524:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787583021.007531:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435808128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007564:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435808128:12345-0@lo:400:kworker.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.007571:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787583021.007597:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435808128:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007628:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435808256:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007653:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583021.007679:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435808256 00000100:00100000:3.0:1787583021.007683:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435808256 00000100:00100000:3.0:1787583021.007704:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787583021.007710:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435808256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007755:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435808256:12345-0@lo:400:kworker.0 Request processed in 45us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.007761:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787583021.007791:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435808256:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007821:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435808384:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007842:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583021.007890:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435808384 00000100:00100000:3.0:1787583021.007894:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435808384 00000100:00100000:3.0:1787583021.007923:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787583021.007929:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435808384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.007961:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435808384:12345-0@lo:400:kworker.0 Request processed in 32us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.007967:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1787583021.007981:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787583021.008001:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435808384:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.008036:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435808512:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.008061:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583021.008102:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435808512 00000100:00100000:3.0:1787583021.008106:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435808512 00000100:00100000:3.0:1787583021.008150:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787583021.008158:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435808512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.008189:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435808512:12345-0@lo:400:kworker.0 Request processed in 32us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.008195:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:3.0:1787583021.008222:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247da4380 x1874416435808512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583021.008239:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435808512:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.008274:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435808640:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.008300:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583021.008329:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435808640 00000100:00100000:3.0:1787583021.008332:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435808640 00000100:00100000:3.0:1787583021.008360:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787583021.008366:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435808640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583021.008994:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787583021.009006:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435808768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583021.009043:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583021.009076:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435808768 00000100:00100000:2.0:1787583021.009080:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435808768 00000100:00100000:2.0:1787583021.009123:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787583021.009131:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435808768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787583021.009154:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583021.009191:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435808768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583021.009196:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787583021.009219:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435808896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583021.009253:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583021.009282:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435808896 00000100:00100000:2.0:1787583021.009285:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435808896 00000100:00080000:1.0:1787583021.009414:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787583021.009418:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787583021.009420:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787583021.011675:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787583021.011696:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435809152:0@lo:400:kworker.0 00000100:00100000:0.0:1787583021.011758:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583021.011822:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435809280:0@lo:400:kworker.0 00000100:00100000:0.0:1787583021.011870:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583021.011987:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787583021.012002:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435808896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787583021.012039:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787583021.012101:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435808896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583021.012124:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787583021.012150:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435809024:0@lo:400:kworker.0 00000100:00100000:2.0:1787583021.012178:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583021.012199:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583021.012205:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435809408:0@lo:400:kworker.0 00000100:00100000:2.0:1787583021.012225:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583021.012274:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435808896:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1787583021.016247:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092477dd180 x1874416435808768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583021.016276:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435808768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583021.016416:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435809152 00000100:00100000:3.0:1787583021.016423:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435809152 00000100:00100000:3.0:1787583021.016495:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435809280 00000100:00100000:3.0:1787583021.016498:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435809280 00000100:00100000:3.0:1787583021.016521:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787583021.016529:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435809152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.016607:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435809152:12345-0@lo:400:kworker.0 Request processed in 78us (4848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.016613:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787583021.016630:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787583021.016636:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435809280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.016666:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435809280:12345-0@lo:400:kworker.0 Request processed in 30us (4795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.016672:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787583021.016691:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435809024 00000100:00100000:3.0:1787583021.016695:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435809024 00000100:00100000:3.0:1787583021.016719:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435809408 00000100:00100000:3.0:1787583021.016723:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435809408 00000100:00100000:3.0:1787583021.016737:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787583021.016752:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435809024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.016790:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435809024:12345-0@lo:400:kworker.0 Request processed in 40us (4611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.016796:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787583021.016806:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787583021.016812:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435809408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.016840:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435809408:12345-0@lo:400:kworker.0 Request processed in 28us (4614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.016878:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1787583021.016932:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc47b80 x1874416435809408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583021.016945:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435809408:0@lo:400:kworker.0 00010000:00080000:3.0:1787583021.016957:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc45f80 x1874416435809024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583021.016966:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435809024:0@lo:400:kworker.0 00010000:00080000:3.0:1787583021.016995:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc47100 x1874416435809280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583021.017005:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435809280:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.017016:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435809152:0@lo:400:kworker.0 00000100:00100000:3.0:1787583021.017052:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435808640:12345-0@lo:400:kworker.0 Request processed in 8686us (8751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.017059:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787583021.018618:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787583021.018626:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787583021.018629:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583021.018632:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787583021.018671:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247da4380 x1874416435808640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583021.018686:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435808640:0@lo:400:kworker.0 00010000:00010000:2.0:1787583021.454142:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583021.519031:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787583021.519058:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435809536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583021.519140:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583021.520306:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435809536 00000100:00100000:3.0:1787583021.520331:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435809536 00000100:00100000:3.0:1787583021.520390:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787583021.520400:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435809536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787583021.520425:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583021.520502:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435809536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583021.520510:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787583021.520608:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247da4380 x1874416435809536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583021.520629:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435809536:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787583022.479818:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583023.503131:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583024.083367:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787583024.083393:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435809664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787583024.083476:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583024.083564:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435809664 00000100:00100000:1.0:1787583024.083573:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435809664 00000100:00100000:1.0:1787583024.083630:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787583024.083640:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435809664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787583024.083690:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787583024.083742:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435809664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583024.083748:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787583024.083790:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435809664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787583024.401438:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583024.401487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583024.401518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583024.401552:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413715072 00000100:00100000:0.0:1787583024.401561:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413715072 00000100:00100000:0.0:1787583024.401611:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:0.0:1787583024.401622:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:2404:x1874416413715072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583024.401711:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+10:2404:x1874416413715072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583024.401718:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:0.0:1787583024.401753:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413715200 00000100:00100000:0.0:1787583024.401757:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413715200 00000100:00100000:0.0:1787583024.401792:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413715328 00000100:00100000:0.0:1787583024.401795:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413715328 00000100:00100000:0.0:1787583024.401830:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:0.0:1787583024.401837:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413715200:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583024.401892:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413715200:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 55us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583024.401899:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:0.0:1787583024.401912:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:0.0:1787583024.401918:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413715328:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583024.402082:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413715328:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 163us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583024.402088:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00080000:0.0:1787583024.402205:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787583024.402210:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787583024.527023:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583025.103135:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435809792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787583025.103206:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583025.103328:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435809792 00000100:00100000:1.0:1787583025.103336:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435809792 00000100:00100000:1.0:1787583025.103394:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787583025.103404:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435809792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787583025.103430:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583025.103474:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435809792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583025.103481:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787583025.103520:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc40000 x1874416435809792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583025.103538:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435809792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583025.103692:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435809920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583025.103718:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787583025.103787:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583025.103828:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435809920 00000100:00100000:0.0:1787583025.103833:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435809920 00000100:00100000:0.0:1787583025.103887:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787583025.103894:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435809920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583025.103904:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787583025.103932:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435809920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583025.103956:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787583025.104051:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787583025.104114:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc45180 x1874416435809920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583025.104127:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435809920:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787583025.554200:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583026.126284:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787583026.126308:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435810048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787583026.126395:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583026.126554:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787583026.126564:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435810176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583026.126603:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583026.126915:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435810176 00000100:00100000:0.0:1787583026.126923:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435810176 00000100:00100000:0.0:1787583026.126963:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787583026.126972:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435810176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787583026.127014:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787583026.127072:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435810176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583026.127083:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787583026.127127:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435810176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583026.130718:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435810048 00000100:00100000:3.0:1787583026.130733:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435810048 00000100:00100000:3.0:1787583026.130886:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787583026.130900:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435810048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787583026.130930:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583026.131016:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435810048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (4621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583026.131023:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1787583026.131457:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092477dd880 x1874416435810048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583026.131478:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435810048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583026.131726:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435810560:0@lo:400:kworker.0 00000100:00100000:2.0:1787583026.131780:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583026.131814:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435811072:0@lo:400:kworker.0 00000100:00100000:2.0:1787583026.131834:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583026.131870:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435811584:0@lo:400:kworker.0 00000100:00100000:2.0:1787583026.131888:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583026.131908:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787583026.131912:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435810432:0@lo:400:kworker.0 00000100:00100000:2.0:1787583026.131931:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583026.131946:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435810944:0@lo:400:kworker.0 00000100:00100000:2.0:1787583026.131962:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583026.131974:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435811456:0@lo:400:kworker.0 00000100:00100000:1.0:1787583026.132123:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435810304:0@lo:400:kworker.0 00000100:00100000:1.0:1787583026.132164:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583026.132188:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435810816:0@lo:400:kworker.0 00000100:00100000:1.0:1787583026.132216:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583026.132231:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435811328:0@lo:400:kworker.0 00000100:00100000:1.0:1787583026.132265:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583026.132283:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787583026.132287:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435810688:0@lo:400:kworker.0 00000100:00100000:1.0:1787583026.132305:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583026.132313:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435811200:0@lo:400:kworker.0 00000100:00100000:1.0:1787583026.132329:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583026.132351:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435810304 00000100:00100000:1.0:1787583026.132357:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435810304 00000100:00100000:1.0:1787583026.132390:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787583026.132396:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435810304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583026.132585:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435810304:12345-0@lo:400:kworker.0 Request processed in 176us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583026.132601:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787583026.132630:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435810432 00000100:00100000:1.0:1787583026.132635:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435810432 00000100:00100000:1.0:1787583026.132653:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435810944 00000100:00100000:1.0:1787583026.132655:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435810944 00000100:00100000:2.0:1787583026.132735:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583026.132763:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435810560 00000100:00100000:2.0:1787583026.132766:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435810560 00000100:00100000:2.0:1787583026.132793:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787583026.132799:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435810560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583026.132836:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435810560:12345-0@lo:400:kworker.0 Request processed in 37us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583026.132842:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787583026.132879:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435811072 00000100:00100000:2.0:1787583026.132883:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435811072 00000100:00100000:2.0:1787583026.132901:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435811584 00000100:00100000:2.0:1787583026.132903:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435811584 00000100:00100000:3.0:1787583026.132955:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435811200 00000100:00100000:3.0:1787583026.132959:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435811200 00000100:00100000:3.0:1787583026.132980:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787583026.132997:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435811072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583026.133030:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435811072:12345-0@lo:400:kworker.0 Request processed in 44us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583026.133036:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787583026.133047:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787583026.133064:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435811200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583026.133090:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435811200:12345-0@lo:400:kworker.0 Request processed in 27us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583026.133095:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787583026.133236:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435810816 00000100:00100000:3.0:1787583026.133240:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435810816 00000100:00080000:0.0:1787583026.133731:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787583026.133737:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787583026.133739:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583026.133770:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435811328 00000100:00100000:0.0:1787583026.133775:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435811328 00000100:00100000:0.0:1787583026.133805:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435810688 00000100:00100000:0.0:1787583026.133808:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435810688 00000100:00100000:0.0:1787583026.133820:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435811456 00000100:00100000:0.0:1787583026.133822:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435811456 00000100:00100000:0.0:1787583026.133837:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787583026.133860:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435810432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583026.133906:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435810432:12345-0@lo:400:kworker.0 Request processed in 63us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583026.133912:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787583026.133925:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787583026.133931:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435811328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583026.133956:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435811328:12345-0@lo:400:kworker.0 Request processed in 26us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583026.133971:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787583026.133983:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787583026.134002:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435810688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583026.134028:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435810688:12345-0@lo:400:kworker.0 Request processed in 28us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583026.134034:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787583026.134045:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787583026.134089:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435811456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583026.134119:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435811456:12345-0@lo:400:kworker.0 Request processed in 69us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583026.134125:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1787583026.134138:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787583026.134925:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787583026.134981:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435810688:0@lo:400:kworker.0 00010000:00080000:0.0:1787583026.135009:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c7800 x1874416435811200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583026.135019:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435811200:0@lo:400:kworker.0 00000100:00100000:0.0:1787583026.135029:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435810304:0@lo:400:kworker.0 00000100:00100000:0.0:1787583026.135059:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435811328:0@lo:400:kworker.0 00000100:00100000:0.0:1787583026.135121:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435810432:0@lo:400:kworker.0 00010000:00080000:0.0:1787583026.135359:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c6300 x1874416435811456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583026.135369:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435811456:0@lo:400:kworker.0 00000100:00100000:0.0:1787583026.135395:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435810560:0@lo:400:kworker.0 00010000:00080000:0.0:1787583026.135405:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c6d80 x1874416435811072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583026.135479:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435811072:0@lo:400:kworker.0 00000100:00100000:1.0:1787583026.135761:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787583026.135772:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435810944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583026.135842:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435810944:12345-0@lo:400:kworker.0 Request processed in 73us (3878us total) trans 0 rc 0/0 00010000:00080000:0.0:1787583026.136365:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c4700 x1874416435810944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583026.136377:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435810944:0@lo:400:kworker.0 00000100:00100000:2.0:1787583026.136460:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787583026.136469:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435811584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583026.136519:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435811584:12345-0@lo:400:kworker.0 Request processed in 52us (4629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583026.136537:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787583026.136567:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c4a80 x1874416435811584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583026.136827:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435811584:0@lo:400:kworker.0 00000100:00100000:3.0:1787583026.137327:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787583026.137340:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435810816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583026.137401:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435810816:12345-0@lo:400:kworker.0 Request processed in 66us (5183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583026.137457:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435810816:0@lo:400:kworker.0 00000100:00100000:1.0:1787583026.137551:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787583026.137667:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00010000:1.0:1787583026.574164:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583026.640024:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787583026.640058:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435811712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583026.640129:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583026.640338:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435811712 00000100:00100000:3.0:1787583026.640346:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435811712 00000100:00100000:3.0:1787583026.640391:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787583026.640400:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435811712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787583026.640439:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583026.640486:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435811712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583026.640493:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787583026.640673:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247da5880 x1874416435811712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583026.640694:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435811712:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787583027.601185:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787583028.100069:0:12004:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:50:25 (1787583025) === 00000100:00100000:3.0:1787583028.599770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583028.611456:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413715456 00000100:00100000:0.0:1787583028.611541:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413715456 00000100:00100000:0.0:1787583028.611809:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00100000:0.0:1787583028.611822:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:8738:x1874416413715456:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787583028.611840:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583028.611887:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713fe00/0x19a47956376b626a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c40ab expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583028.611919:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713fe00/0x19a47956376b626a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40ab expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583028.611930:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713fe00/0x19a47956376b626a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40ab expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583028.611939:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fe00, rc 0) 00000100:00100000:0.0:1787583028.612087:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+11:8738:x1874416413715456:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 265us (12326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583028.612094:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 291 00010000:00010000:1.0:1787583028.622094:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583028.635271:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583028.635448:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413715584 00000100:00100000:2.0:1787583028.635458:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413715584 00000100:00100000:2.0:1787583028.635519:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 292 00000100:00100000:2.0:1787583028.635529:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+11:8738:x1874416413715584:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787583028.635925:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+11:8738:x1874416413715584:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 394us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583028.635934:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 292 00000100:00100000:2.0:1787583028.646256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583028.646437:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413715712 00000100:00100000:0.0:1787583028.646446:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413715712 00000100:00100000:0.0:1787583028.646520:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 293 00000100:00100000:0.0:1787583028.646530:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+11:8738:x1874416413715712:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787583028.646721:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+11:8738:x1874416413715712:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 192us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583028.646729:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 293 00000100:00100000:3.0:1787583028.657116:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583028.657745:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413715840 00000100:00100000:2.0:1787583028.657756:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413715840 00000100:00100000:2.0:1787583028.657818:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 294 00000100:00100000:2.0:1787583028.657833:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+11:8742:x1874416413715840:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787583028.658046:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+11:8742:x1874416413715840:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 217us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583028.658053:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 294 00000100:00100000:2.0:1787583028.681657:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583028.682713:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413715968 00000100:00100000:1.0:1787583028.682727:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413715968 00000100:00100000:1.0:1787583028.682796:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 295 00000100:00100000:1.0:1787583028.682807:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+11:8742:x1874416413715968:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787583028.685534:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+11:8742:x1874416413715968:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 2717us (3876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583028.685550:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 295 00000100:00100000:1.0:1787583028.699715:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583028.701356:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413716096 00000100:00100000:0.0:1787583028.701370:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413716096 00000100:00100000:0.0:1787583028.701500:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 296 00000100:00100000:0.0:1787583028.701513:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+11:8742:x1874416413716096:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787583028.701709:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+11:8742:x1874416413716096:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 198us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583028.701716:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 296 00000100:00100000:3.0:1787583028.737192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583028.737330:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413716224 00000100:00100000:1.0:1787583028.737340:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413716224 00000100:00100000:1.0:1787583028.737397:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 297 00000100:00100000:1.0:1787583028.737406:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+11:8738:x1874416413716224:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787583028.737421:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583028.737449:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367ea00/0x19a47956376b6271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c40dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583028.737477:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367ea00/0x19a47956376b6271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40dc expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583028.737488:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367ea00/0x19a47956376b6271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40dc expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583028.737498:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367ea00, rc 0) 00000100:00100000:1.0:1787583028.737559:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+12:8738:x1874416413716224:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 155us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583028.737565:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 297 00000100:00100000:1.0:1787583028.747390:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583028.747947:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413716352 00000100:00100000:0.0:1787583028.747958:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413716352 00000100:00100000:0.0:1787583028.748019:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 298 00000100:00100000:0.0:1787583028.749232:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+12:8738:x1874416413716352:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787583028.749266:0:6522:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787583028.749292:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787583028.749296:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787583028.749300:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787583028.749308:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787583028.749311:0:6522:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787583028.753116:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+12:8738:x1874416413716352:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 5077us (5725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583028.753131:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 298 00000100:00100000:3.0:1787583028.762200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583028.762343:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413716480 00000100:00100000:2.0:1787583028.762354:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413716480 00000100:00100000:2.0:1787583028.762413:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 299 00000100:00100000:2.0:1787583028.762423:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+12:8738:x1874416413716480:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787583028.762441:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583028.762457:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924770b600/0x19a47956376b6278 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c40e3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583028.762485:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924770b600/0x19a47956376b6278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40e3 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583028.762496:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924770b600/0x19a47956376b6278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40e3 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583028.762505:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770b600, rc 0) 00000100:00100000:2.0:1787583028.762718:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:8738:x1874416413716480:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 295us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583028.762726:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 299 00000100:00100000:1.0:1787583028.771635:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583028.771789:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413716608 00000100:00100000:0.0:1787583028.771798:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413716608 00000100:00100000:0.0:1787583028.771885:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 300 00000100:00100000:0.0:1787583028.771895:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:8738:x1874416413716608:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787583028.772069:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:8738:x1874416413716608:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 175us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583028.772077:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 300 00000100:00100000:2.0:1787583028.775108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583028.775201:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413716736 00000100:00100000:0.0:1787583028.775210:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413716736 00000100:00100000:0.0:1787583028.775263:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 301 00000100:00100000:0.0:1787583028.775273:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:8738:x1874416413716736:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787583028.775793:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:8738:x1874416413716736:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 517us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583028.775801:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 301 00000100:00100000:2.0:1787583028.780886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583028.781743:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413716864 00000100:00100000:1.0:1787583028.781756:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413716864 00000100:00100000:1.0:1787583028.781819:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 302 00000100:00100000:1.0:1787583028.781829:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:8746:x1874416413716864:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787583028.782028:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:8746:x1874416413716864:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 199us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583028.782045:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 302 00000100:00100000:1.0:1787583028.784535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583028.784670:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413716992 00000100:00100000:0.0:1787583028.784679:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413716992 00000100:00100000:0.0:1787583028.784740:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 303 00000100:00100000:0.0:1787583028.784749:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:8746:x1874416413716992:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787583028.784926:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:8746:x1874416413716992:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 177us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583028.784933:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 303 00000100:00100000:2.0:1787583028.792681:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583028.792729:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583028.792882:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413717120 00000100:00100000:1.0:1787583028.792892:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413717120 00000100:00100000:1.0:1787583028.792938:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413717376 00000100:00100000:1.0:1787583028.792942:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413717376 00000100:00100000:1.0:1787583028.792969:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1787583028.792978:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1874416413717120:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787583028.793015:0:6527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b124cdab-8363-4433-96a8-2d8722f1634b@192.168.203.11@tcp t0 exp 0000000000000000 cur 335 last 0 00000100:00100000:3.0:1787583028.793101:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1787583028.793109:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1874416413717376:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787583028.793129:0:6529:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from b124cdab-8363-4433-96a8-2d8722f1634b@192.168.203.11@tcp t0 exp 0000000000000000 cur 335 last 0 00000020:00000080:1.0:1787583028.793176:0:6527:0:(genops.c:1385:class_connect()) connect: client b124cdab-8363-4433-96a8-2d8722f1634b, cookie 0x19a47956376b627f 00000004:00100000:1.0:1787583028.793201:0:6527:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787583028.793317:0:6527:0:(import.c:65:import_set_state_nolock()) ffff90937fc00000 : changing import state from RECOVER to FULL 00000020:00000080:3.0:1787583028.793626:0:6529:0:(genops.c:1385:class_connect()) connect: client b124cdab-8363-4433-96a8-2d8722f1634b, cookie 0x19a47956376b6286 00000004:00100000:3.0:1787583028.793642:0:6529:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787583028.793707:0:6529:0:(import.c:65:import_set_state_nolock()) ffff90937fb90800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787583028.793753:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+6:2403:x1874416413717376:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 641us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583028.793754:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+6:2403:x1874416413717120:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 773us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583028.793766:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1787583028.793776:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1787583028.802987:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583028.803279:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413717760 00000100:00100000:1.0:1787583028.803289:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413717760 00000100:00100000:1.0:1787583028.803368:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:1.0:1787583028.803387:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413717760:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:0.0:1787583028.803587:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787583028.809149:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413717760:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 5760us (6159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583028.809163:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:2.0:1787583028.809290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583028.809449:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583028.809487:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583028.809547:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413717632 00000100:00100000:0.0:1787583028.809556:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413717632 00000100:00100000:0.0:1787583028.809608:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413717248 00000100:00100000:0.0:1787583028.809611:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413717248 00000100:00100000:0.0:1787583028.809625:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413717504 00000100:00100000:0.0:1787583028.809628:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413717504 00000100:00100000:0.0:1787583028.809646:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:0.0:1787583028.809654:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413717632:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583028.809751:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1787583028.809760:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+6:0:x1874416413717248:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787583028.809811:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787583028.815823:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413717632:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 6153us (6517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583028.815840:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:0.0:1787583028.816047:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1787583028.816065:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+6:0:x1874416413717504:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787583028.816108:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787583028.816369:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+6:0:x1874416413717248:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 6608us (6919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583028.816489:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00080000:2.0:1787583028.816977:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583028.816997:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787583028.817152:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+6:0:x1874416413717504:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 1093us (7661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583028.817161:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1787583028.818727:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583028.818925:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413717888 00000100:00100000:1.0:1787583028.818936:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413717888 00000100:00100000:1.0:1787583028.818996:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1787583028.819006:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+6:8738:x1874416413717888:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787583028.819073:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787583028.819148:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+6:8738:x1874416413717888:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 143us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583028.819155:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1787583028.827046:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583028.827288:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413718016 00000100:00100000:3.0:1787583028.827298:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413718016 00000100:00100000:3.0:1787583028.827362:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1787583028.827373:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+6:8738:x1874416413718016:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787583028.830110:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+6:8738:x1874416413718016:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 2727us (3071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583028.830126:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1787583028.835551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583028.835886:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413718400 00000100:00100000:1.0:1787583028.835896:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413718400 00000100:00100000:1.0:1787583028.835956:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1787583028.835968:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b124cdab-8363-4433-96a8-2d8722f1634b+6:8738:x1874416413718400:12345-192.168.203.11@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787583028.836057:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b124cdab-8363-4433-96a8-2d8722f1634b+6:8738:x1874416413718400:12345-192.168.203.11@tcp:900:mount.lustre.0 Request processed in 92us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583028.836065:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:0.0:1787583028.838422:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583028.838466:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583028.838557:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413718144 00000100:00100000:3.0:1787583028.838566:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413718144 00000100:00100000:3.0:1787583028.838607:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413718272 00000100:00100000:3.0:1787583028.838611:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413718272 00000100:00100000:3.0:1787583028.838638:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:3.0:1787583028.838645:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1874416413718144:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787583028.838677:0:8444:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b124cdab-8363-4433-96a8-2d8722f1634b@192.168.203.11@tcp t0 exp 0000000000000000 cur 335 last 0 00000100:00100000:2.0:1787583028.838695:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1787583028.838703:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1874416413718272:12345-192.168.203.11@tcp:8:mount.lustre.0 00000020:00000080:3.0:1787583028.838717:0:8444:0:(genops.c:1385:class_connect()) connect: client b124cdab-8363-4433-96a8-2d8722f1634b, cookie 0x19a47956376b628d 00010000:00080000:2.0:1787583028.838729:0:8752:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b124cdab-8363-4433-96a8-2d8722f1634b@192.168.203.11@tcp t0 exp 0000000000000000 cur 335 last 0 00002000:00100000:3.0:1787583028.838732:0:8444:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b124cdab-8363-4433-96a8-2d8722f1634b/ffff90937fb94800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:2.0:1787583028.838751:0:8752:0:(genops.c:1385:class_connect()) connect: client b124cdab-8363-4433-96a8-2d8722f1634b, cookie 0x19a47956376b6294 00002000:00100000:3.0:1787583028.838756:0:8444:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:2.0:1787583028.838760:0:8752:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b124cdab-8363-4433-96a8-2d8722f1634b/ffff90937fc53000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787583028.838775:0:8752:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787583028.838842:0:8752:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:3.0:1787583028.838878:0:8444:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787583028.838902:0:8444:0:(import.c:65:import_set_state_nolock()) ffff90937fb92800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787583028.838902:0:8752:0:(import.c:65:import_set_state_nolock()) ffff90937fc57000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787583028.839110:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b124cdab-8363-4433-96a8-2d8722f1634b+6:2403:x1874416413718272:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 404us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583028.839119:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1787583028.839805:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b124cdab-8363-4433-96a8-2d8722f1634b+6:2403:x1874416413718144:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 1155us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583028.839814:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1787583028.840115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583028.840609:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413718528 00000100:00100000:2.0:1787583028.840617:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413718528 00000100:00100000:2.0:1787583028.840670:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1787583028.840680:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b124cdab-8363-4433-96a8-2d8722f1634b+6:8738:x1874416413718528:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787583028.840766:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787583028.840868:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b124cdab-8363-4433-96a8-2d8722f1634b+6:8738:x1874416413718528:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 188us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583028.840875:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1787583029.198171:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787583029.198199:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435811840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787583029.198270:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583029.198444:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435811840 00000100:00100000:1.0:1787583029.198454:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435811840 00000100:00100000:1.0:1787583029.198510:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787583029.198520:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435811840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787583029.198555:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787583029.198616:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435811840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583029.198622:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787583029.198804:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435811840:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787583029.646813:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583030.222781:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583030.222803:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435811968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787583030.222897:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583030.222952:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435811968 00000100:00100000:2.0:1787583030.222959:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435811968 00000100:00100000:2.0:1787583030.223005:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787583030.223013:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435811968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583030.223054:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583030.223092:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435811968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583030.223098:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787583030.223116:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787583030.223141:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc88a80 x1874416435811968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583030.223158:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435811968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583030.225490:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787583030.245044:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435812096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583030.245117:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583030.245528:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435812096 00000100:00100000:0.0:1787583030.245537:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435812096 00000100:00100000:0.0:1787583030.245617:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787583030.245628:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435812096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583030.245652:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787583030.245701:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435812096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583030.245720:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1787583030.245890:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc45180 x1874416435812096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583030.245918:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435812096:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787583030.246035:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787583030.670978:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583031.246218:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787583031.247744:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583031.247765:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435812480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583031.247831:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583031.247932:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435812480 00000100:00100000:2.0:1787583031.247939:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435812480 00000100:00100000:2.0:1787583031.247994:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787583031.248005:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435812480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787583031.248043:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583031.248104:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435812480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583031.248111:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1787583031.248149:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc88a80 x1874416435812480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583031.248169:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435812480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787583031.250513:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435812352:0@lo:400:kworker.0 00000100:00100000:0.0:1787583031.250648:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583031.250700:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435812224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787583031.250730:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583031.250842:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435812352 00000100:00100000:3.0:1787583031.250876:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435812352 00000100:00100000:3.0:1787583031.250920:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787583031.250930:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435812352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583031.250984:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435812352:12345-0@lo:400:kworker.0 Request processed in 55us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583031.250991:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787583031.251046:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435812352:0@lo:400:kworker.0 00000100:00100000:2.0:1787583031.251682:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435812224 00000100:00100000:2.0:1787583031.251690:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435812224 00000100:00100000:2.0:1787583031.251735:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787583031.251744:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435812224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787583031.251770:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787583031.251822:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435812224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583031.251828:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1787583031.251880:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583031.251986:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435812224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583031.252826:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583031.252891:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787583031.252903:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435812736:0@lo:400:kworker.0 00000100:00100000:0.0:1787583031.252943:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583031.252996:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435812864:0@lo:400:kworker.0 00000100:00100000:0.0:1787583031.253037:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583031.253112:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435812864 00000100:00100000:1.0:1787583031.253118:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435812864 00000100:00100000:1.0:1787583031.253158:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787583031.253166:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435812864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.253242:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435812864:12345-0@lo:400:kworker.0 Request processed in 64us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583031.253249:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787583031.253286:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435812864:0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.255336:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583031.255364:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435812992:0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.255432:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583031.255488:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435812992 00000100:00100000:1.0:1787583031.255494:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435812992 00000100:00100000:1.0:1787583031.255550:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787583031.255561:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435812992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583031.255567:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435812608:0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.255617:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435812992:12345-0@lo:400:kworker.0 Request processed in 58us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583031.255624:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1787583031.255643:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787583031.255673:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435812992:0@lo:400:kworker.0 00000100:00100000:2.0:1787583031.255789:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435812736 00000100:00100000:2.0:1787583031.255794:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435812736 00000100:00100000:2.0:1787583031.255821:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787583031.255827:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435812736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583031.255900:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435812736:12345-0@lo:400:kworker.0 Request processed in 72us (2955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583031.255906:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787583031.256046:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435812736:0@lo:400:kworker.0 00000100:00100000:3.0:1787583031.256477:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583031.256682:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435812608 00000100:00100000:1.0:1787583031.256688:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435812608 00000100:00100000:1.0:1787583031.256731:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787583031.256739:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435812608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.256833:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435812608:12345-0@lo:400:kworker.0 Request processed in 95us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583031.256840:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787583031.259797:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435813120:0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.259909:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583031.259943:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435813632:0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.259965:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583031.259991:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583031.259998:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435813504:0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.260032:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583031.260064:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435813120 00000100:00100000:1.0:1787583031.260071:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435813120 00000100:00100000:1.0:1787583031.260118:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435813632 00000100:00100000:1.0:1787583031.260121:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435813632 00000100:00100000:1.0:1787583031.260135:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435813504 00000100:00100000:1.0:1787583031.260138:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435813504 00000100:00100000:1.0:1787583031.260157:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787583031.260164:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435813120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.260212:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435813120:12345-0@lo:400:kworker.0 Request processed in 48us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583031.260219:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787583031.260248:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787583031.260256:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435813632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.260283:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435813632:12345-0@lo:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583031.260289:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787583031.260300:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787583031.260483:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435813504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.260516:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435813504:12345-0@lo:400:kworker.0 Request processed in 36us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583031.260534:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1787583031.260557:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787583031.260561:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787583031.260575:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435813376:0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.260678:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583031.260703:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787583031.260710:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435813248:0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.260733:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583031.260751:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435813760:0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.260770:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583031.260796:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435813376 00000100:00100000:1.0:1787583031.260800:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435813376 00000100:00100000:1.0:1787583031.260835:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435813248 00000100:00100000:1.0:1787583031.260839:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435813248 00000100:00100000:1.0:1787583031.260876:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435813760 00000100:00100000:1.0:1787583031.260879:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435813760 00000100:00100000:1.0:1787583031.260903:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787583031.260909:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435813376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.260944:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435813376:12345-0@lo:400:kworker.0 Request processed in 35us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583031.260949:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787583031.260962:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787583031.260968:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435813248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.260995:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435813248:12345-0@lo:400:kworker.0 Request processed in 27us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583031.261001:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787583031.261039:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787583031.261046:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435813760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583031.261075:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435813760:12345-0@lo:400:kworker.0 Request processed in 30us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583031.261080:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787583031.261099:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787583031.261129:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435813504:0@lo:400:kworker.0 00010000:00080000:1.0:1787583031.261143:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc45f80 x1874416435813120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583031.261155:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435813120:0@lo:400:kworker.0 00010000:00080000:1.0:1787583031.261165:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092477dd880 x1874416435813632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583031.261174:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435813632:0@lo:400:kworker.0 00010000:00080000:1.0:1787583031.261206:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc45880 x1874416435813248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583031.261215:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435813248:0@lo:400:kworker.0 00010000:00080000:1.0:1787583031.261224:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c5180 x1874416435813760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583031.262084:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435813760:0@lo:400:kworker.0 00010000:00080000:1.0:1787583031.262106:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc44380 x1874416435813376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583031.262115:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435813376:0@lo:400:kworker.0 00000100:00100000:3.0:1787583031.262812:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435812608:0@lo:400:kworker.0 00010000:00010000:2.0:1787583031.694249:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583031.763952:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435813888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583031.764039:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583031.764172:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435813888 00000100:00100000:3.0:1787583031.764180:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435813888 00000100:00100000:3.0:1787583031.764233:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787583031.764242:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435813888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787583031.764265:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583031.764311:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435813888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583031.764318:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1787583031.764397:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247da4380 x1874416435813888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583031.764429:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435813888:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787583032.720806:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583033.743163:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787583033.801648:0:12196:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1787583034.131608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583034.131656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583034.131686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583034.131718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583034.131739:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583034.131756:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583034.131799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583034.131830:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413719424 00000100:00100000:1.0:1787583034.131840:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413719424 00000100:00100000:1.0:1787583034.131921:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413719296 00000100:00100000:1.0:1787583034.131925:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413719296 00000100:00100000:1.0:1787583034.131948:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1787583034.131958:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b124cdab-8363-4433-96a8-2d8722f1634b+6:2404:x1874416413719424:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583034.132040:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b124cdab-8363-4433-96a8-2d8722f1634b+6:2404:x1874416413719424:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 83us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583034.132048:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1787583034.132066:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1787583034.132073:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b124cdab-8363-4433-96a8-2d8722f1634b+6:2404:x1874416413719296:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583034.132097:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b124cdab-8363-4433-96a8-2d8722f1634b+6:2404:x1874416413719296:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583034.132104:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1787583034.132123:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413718912 00000100:00100000:1.0:1787583034.132127:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413718912 00000100:00100000:1.0:1787583034.132145:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413719168 00000100:00100000:1.0:1787583034.132148:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413719168 00000100:00100000:1.0:1787583034.132159:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413718784 00000100:00100000:1.0:1787583034.132161:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413718784 00000100:00100000:1.0:1787583034.132172:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413719040 00000100:00100000:1.0:1787583034.132186:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413719040 00000100:00100000:1.0:1787583034.132204:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:1.0:1787583034.132210:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413718912:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583034.132238:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413718912:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583034.132245:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:1.0:1787583034.132257:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:1.0:1787583034.132263:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+6:2404:x1874416413719168:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583034.132287:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+6:2404:x1874416413719168:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583034.132293:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:1.0:1787583034.132304:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:1.0:1787583034.132310:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413718784:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583034.132333:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413718784:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583034.132339:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:1.0:1787583034.132350:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:1.0:1787583034.132356:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+6:2404:x1874416413719040:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583034.132377:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+6:2404:x1874416413719040:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583034.132384:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00080000:1.0:1787583034.132405:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787583034.132409:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787583034.132412:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787583034.132420:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583034.134757:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413718656 00000100:00100000:3.0:1787583034.134771:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413718656 00000100:00100000:3.0:1787583034.134838:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 305 00000100:00100000:3.0:1787583034.134883:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2404:x1874416413718656:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583034.134974:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2404:x1874416413718656:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 126us (3375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583034.134981:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 305 00000100:00100000:1.0:1787583034.318570:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583034.318594:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435814016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583034.318664:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583034.318787:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435814016 00000100:00100000:3.0:1787583034.318796:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435814016 00000100:00100000:3.0:1787583034.318870:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787583034.318892:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435814016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787583034.318927:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787583034.318979:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435814016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583034.318986:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787583034.319046:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435814016:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787583034.766936:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787583034.836804:0:8437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b124cdab-8363-4433-96a8-2d8722f1634b 00000001:00100000:1.0:1787583034.837106:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b124cdab-8363-4433-96a8-2d8722f1634b 00000001:00100000:0.0:1787583034.843677:0:7459:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b124cdab-8363-4433-96a8-2d8722f1634b 00000001:00100000:2.0:1787583034.843866:0:6506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b124cdab-8363-4433-96a8-2d8722f1634b 00000100:00100000:1.0:1787583035.342164:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435814144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583035.342240:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583035.342364:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435814144 00000100:00100000:2.0:1787583035.342374:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435814144 00000100:00100000:2.0:1787583035.342429:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787583035.342439:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435814144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583035.342470:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583035.342711:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435814272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583035.342743:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787583035.342969:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787583035.343258:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435814144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 819us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583035.343267:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787583035.343284:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435814272 00000100:00100000:2.0:1787583035.343289:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435814272 00000100:00100000:2.0:1787583035.343313:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787583035.343320:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435814272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787583035.343333:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583035.343387:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435814272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583035.343393:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787583035.343503:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787583035.343575:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247da4380 x1874416435814272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583035.343596:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435814272:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787583035.343787:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc8a680 x1874416435814144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583035.343803:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435814144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787583035.790841:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583036.367201:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787583036.367225:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435814400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583036.367531:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583036.367542:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435814656:0@lo:400:kworker.0 00000100:00100000:1.0:1787583036.367570:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583036.367582:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435814784:0@lo:400:kworker.0 00000100:00100000:1.0:1787583036.367593:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435815168:0@lo:400:kworker.0 00000100:00100000:1.0:1787583036.367610:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583036.367630:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435815680:0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.367642:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583036.367647:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583036.367658:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435815296:0@lo:400:kworker.0 00000100:00100000:1.0:1787583036.367663:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787583036.367667:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435814528:0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.367677:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583036.367687:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583036.367704:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435815808:0@lo:400:kworker.0 00000100:00100000:1.0:1787583036.367704:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435815040:0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.367722:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583036.367722:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583036.367734:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787583036.367734:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435815552:0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.367738:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435814912:0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.367756:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583036.367761:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583036.367765:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435815424:0@lo:400:kworker.0 00000100:00100000:1.0:1787583036.367775:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435816064:0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.367782:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583036.367792:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583036.367796:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435815936:0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.367813:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583036.367817:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435814656 00000100:00100000:1.0:1787583036.367823:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435814656 00000100:00100000:3.0:1787583036.367837:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435814400 00000100:00100000:3.0:1787583036.367840:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435814400 00000100:00100000:1.0:1787583036.367876:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435815168 00000100:00100000:3.0:1787583036.367877:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435814784 00000100:00100000:3.0:1787583036.367880:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435814784 00000100:00100000:1.0:1787583036.367880:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435815168 00000100:00100000:3.0:1787583036.367889:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435815040 00000100:00100000:3.0:1787583036.367891:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435815040 00000100:00100000:1.0:1787583036.367900:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435815680 00000100:00100000:1.0:1787583036.367903:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435815680 00000100:00100000:3.0:1787583036.367904:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787583036.367912:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936a141050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435814400:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583036.367913:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435815296 00000100:00100000:1.0:1787583036.367915:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435815296 00000100:00100000:1.0:1787583036.367924:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435815808 00000100:00100000:1.0:1787583036.367926:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435815808 00000100:00100000:1.0:1787583036.367934:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435814912 00000100:00100000:1.0:1787583036.367936:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435814912 00000100:00100000:1.0:1787583036.367946:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787583036.367951:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435814656:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1787583036.367958:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787583036.368004:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936a141050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435814400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583036.368004:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435814656:12345-0@lo:400:kworker.0 Request processed in 51us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583036.368011:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787583036.368011:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787583036.368027:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787583036.368032:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435815168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.368257:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787583036.368263:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435814784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.368304:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435814784:12345-0@lo:400:kworker.0 Request processed in 41us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583036.368310:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787583036.368323:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787583036.368336:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435815040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583036.368371:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787583036.368376:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435815040:12345-0@lo:400:kworker.0 Request processed in 41us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583036.368381:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787583036.368381:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435816192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583036.368405:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787583036.368407:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583036.368413:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435815680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.368440:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435815680:12345-0@lo:400:kworker.0 Request processed in 29us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583036.368446:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787583036.368448:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435816192 00000100:00100000:0.0:1787583036.368451:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435816192 00000100:00100000:3.0:1787583036.368457:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787583036.368462:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435815296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583036.368479:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787583036.368485:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435816192:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583036.368486:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435815296:12345-0@lo:400:kworker.0 Request processed in 24us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583036.368491:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787583036.368501:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00002000:00000024:0.0:1787583036.368502:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583036.368506:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435815808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.368527:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435815808:12345-0@lo:400:kworker.0 Request processed in 21us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583036.368530:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435816192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583036.368533:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787583036.368541:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787583036.368544:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787583036.368549:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435814912:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787583036.368650:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc8aa00 x1874416435816192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583036.368668:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435816192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583036.368749:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435814912:12345-0@lo:400:kworker.0 Request processed in 199us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583036.368755:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787583036.368775:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435815552 00000100:00100000:3.0:1787583036.368783:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435815552 00000100:00100000:3.0:1787583036.368801:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435815424 00000100:00100000:3.0:1787583036.368804:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435815424 00000100:00100000:3.0:1787583036.368813:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435816064 00000100:00100000:3.0:1787583036.368815:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435816064 00000100:00100000:3.0:1787583036.368824:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435815936 00000100:00100000:3.0:1787583036.368826:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435815936 00000100:00100000:3.0:1787583036.368839:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787583036.368862:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435815552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.368894:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435815552:12345-0@lo:400:kworker.0 Request processed in 49us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583036.368899:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787583036.368911:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787583036.368916:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435815424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.369114:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435815424:12345-0@lo:400:kworker.0 Request processed in 24us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583036.369123:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787583036.369137:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787583036.369144:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435816064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.369175:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435816064:12345-0@lo:400:kworker.0 Request processed in 32us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583036.369180:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787583036.369191:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787583036.369197:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435815936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.369223:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435815936:12345-0@lo:400:kworker.0 Request processed in 27us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583036.369229:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787583036.369267:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435814912:0@lo:400:kworker.0 00010000:00080000:3.0:1787583036.369279:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c5880 x1874416435815424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583036.369288:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435815424:0@lo:400:kworker.0 00000100:00100000:1.0:1787583036.369293:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435815168:12345-0@lo:400:kworker.0 Request processed in 1250us (1671us total) trans 0 rc 0/0 00010000:00080000:3.0:1787583036.369298:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c5f80 x1874416435815936/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583036.369300:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787583036.369306:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435815936:0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.369316:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435814784:0@lo:400:kworker.0 00010000:00080000:3.0:1787583036.369324:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c4e00 x1874416435815296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583036.369329:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435814528 00000100:00100000:3.0:1787583036.369332:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435815296:0@lo:400:kworker.0 00000100:00100000:1.0:1787583036.369333:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435814528 00000100:00100000:1.0:1787583036.369362:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787583036.369368:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3654:x1874416435814528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583036.369403:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3654:x1874416435814528:12345-0@lo:400:kworker.0 Request processed in 35us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583036.369408:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:1.0:1787583036.369456:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787583036.369461:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787583036.369463:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787583036.369483:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435814528:0@lo:400:kworker.0 00000100:00100000:1.0:1787583036.369494:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435815040:0@lo:400:kworker.0 00010000:00080000:1.0:1787583036.369504:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c5c00 x1874416435815552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583036.369513:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435815552:0@lo:400:kworker.0 00010000:00080000:1.0:1787583036.369522:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c4000 x1874416435816064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787583036.369529:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c4380 x1874416435815808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583036.369530:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435816064:0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.369538:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435815808:0@lo:400:kworker.0 00000100:00100000:1.0:1787583036.369538:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435814656:0@lo:400:kworker.0 00000100:00100000:1.0:1787583036.369548:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435815168:0@lo:400:kworker.0 00000100:00100000:3.0:1787583036.369549:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435814400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583036.369557:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435815680:0@lo:400:kworker.0 00010000:00010000:0.0:1787583036.814382:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583036.883003:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435816320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787583036.883268:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583036.883466:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435816320 00000100:00100000:2.0:1787583036.883473:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435816320 00000100:00100000:2.0:1787583036.883531:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787583036.883540:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435816320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583036.883562:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583036.883635:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435816320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583036.883641:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1787583036.883654:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247c9f100 x1874416435816320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583036.883673:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435816320:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787583037.843573:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583038.864228:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583039.250398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583039.250434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583039.250470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583039.250516:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583039.250533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583039.250576:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583039.250600:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583039.250639:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413719680 00000100:00100000:1.0:1787583039.250649:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413719680 00000100:00100000:1.0:1787583039.250697:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413719936 00000100:00100000:1.0:1787583039.250700:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413719936 00000100:00100000:3.0:1787583039.250794:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413719808 00000100:00100000:3.0:1787583039.250806:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413719808 00000100:00100000:3.0:1787583039.250838:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413720064 00000100:00100000:3.0:1787583039.250841:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413720064 00000100:00100000:3.0:1787583039.250891:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:3.0:1787583039.250900:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413719680:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583039.250984:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413719680:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 85us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583039.250990:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:3.0:1787583039.251007:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:3.0:1787583039.251014:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413719808:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583039.251040:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413719808:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583039.251046:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:3.0:1787583039.251059:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00100000:3.0:1787583039.251066:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413720064:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583039.251090:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413720064:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583039.251097:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00100000:0.0:1787583039.251457:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413720192 00000100:00100000:0.0:1787583039.251462:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413720192 00000100:00100000:0.0:1787583039.251500:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413720320 00000100:00100000:0.0:1787583039.251504:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413720320 00000100:00100000:0.0:1787583039.251526:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1787583039.251533:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413720192:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583039.251569:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413720192:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583039.251576:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1787583039.251589:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:0.0:1787583039.251595:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413720320:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583039.251618:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413720320:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583039.251635:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:0.0:1787583039.251653:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413719552 00000100:00100000:0.0:1787583039.251656:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413719552 00000100:00100000:0.0:1787583039.251760:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 307 00000100:00100000:0.0:1787583039.251767:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413719552:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583039.251793:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413719552:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583039.251809:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 307 00000100:00100000:1.0:1787583039.252384:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 153 00000100:00100000:1.0:1787583039.252396:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413719936:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583039.252443:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413719936:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 51us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583039.252450:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 153 00000100:00080000:1.0:1787583039.252808:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787583039.252813:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787583039.252816:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787583039.252818:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787583039.438421:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435816448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583039.438500:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583039.438655:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435816448 00000100:00100000:2.0:1787583039.438664:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435816448 00000100:00100000:2.0:1787583039.438718:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787583039.438728:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435816448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787583039.438758:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787583039.438810:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435816448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583039.438817:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787583039.439271:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435816448:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787583039.887642:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787583040.425590:0:12513:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787583040.425820:0:12513:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787583040.463014:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583040.463036:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435816576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583040.463109:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583040.463175:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435816576 00000100:00100000:1.0:1787583040.463183:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435816576 00000100:00100000:1.0:1787583040.463236:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787583040.463245:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937e7d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435816576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787583040.463284:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583040.463327:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937e7d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435816576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583040.463335:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1787583040.463503:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787583040.463533:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c5180 x1874416435816576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583040.463551:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435816576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583040.463773:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787583040.463784:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435816704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583040.463825:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583040.463975:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435816704 00000100:00100000:1.0:1787583040.463980:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435816704 00000100:00100000:1.0:1787583040.464022:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787583040.464029:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435816704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787583040.464039:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583040.464072:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435816704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583040.464078:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1787583040.464104:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c5180 x1874416435816704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583040.464117:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435816704:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787583040.464159:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787583040.909980:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583041.497748:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435817216:0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.497833:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583041.497922:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435817728:0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.497972:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583041.498006:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435818240:0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.498028:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583041.498059:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787583041.498065:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435817088:0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.498089:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583041.498104:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435817600:0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.498121:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583041.498134:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435818112:0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.498151:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583041.498442:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435817216 00000100:00100000:3.0:1787583041.498450:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435817216 00000100:00100000:3.0:1787583041.498490:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435817600 00000100:00100000:3.0:1787583041.498493:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435817600 00000100:00100000:3.0:1787583041.498514:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435818112 00000100:00100000:3.0:1787583041.498517:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435818112 00000100:00100000:3.0:1787583041.498533:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787583041.498541:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435817216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.498594:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435817216:12345-0@lo:400:kworker.0 Request processed in 54us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.498601:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787583041.498619:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787583041.498625:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435817600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.498652:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435817600:12345-0@lo:400:kworker.0 Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.498666:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787583041.498678:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787583041.498683:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435818112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.498709:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435818112:12345-0@lo:400:kworker.0 Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.498715:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787583041.498756:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435817728 00000100:00100000:3.0:1787583041.498760:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435817728 00000100:00100000:3.0:1787583041.498779:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435818240 00000100:00100000:3.0:1787583041.498782:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435818240 00000100:00100000:3.0:1787583041.498796:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787583041.498802:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435817728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.498831:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435817728:12345-0@lo:400:kworker.0 Request processed in 30us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.498837:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787583041.498869:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787583041.498877:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435818240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.498905:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435818240:12345-0@lo:400:kworker.0 Request processed in 29us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.498911:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787583041.499006:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787583041.499011:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787583041.499039:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245892300 x1874416435817600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583041.499053:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435817600:0@lo:400:kworker.0 00010000:00080000:3.0:1787583041.499064:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936d838000 x1874416435818112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583041.499083:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435818112:0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.499095:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435817216:0@lo:400:kworker.0 00010000:00080000:3.0:1787583041.499104:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245892d80 x1874416435817728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583041.499110:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435817728:0@lo:400:kworker.0 00010000:00080000:3.0:1787583041.499118:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936d839180 x1874416435818240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583041.499126:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435818240:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.499398:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435816832:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.499436:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583041.499465:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435817344:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.499488:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583041.499507:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435817856:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.499528:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583041.499545:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435818368:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.499565:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583041.499579:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787583041.499585:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435816960:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.499616:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583041.499632:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435817472:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.499650:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583041.499664:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435817984:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.499680:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583041.499689:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435818496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583041.499707:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583041.499740:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435817088 00000100:00100000:1.0:1787583041.499745:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435817088 00000100:00100000:1.0:1787583041.499767:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435817344 00000100:00100000:1.0:1787583041.499770:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435817344 00000100:00100000:1.0:1787583041.499780:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435818496 00000100:00100000:1.0:1787583041.499782:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435818496 00000100:00100000:1.0:1787583041.499793:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787583041.499799:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435817088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.499874:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435817856 00000100:00100000:3.0:1787583041.499879:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435817856 00000100:00100000:3.0:1787583041.499898:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435818368 00000100:00100000:3.0:1787583041.499900:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435818368 00000100:00100000:3.0:1787583041.499918:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787583041.500125:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787583041.500135:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435818368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.500354:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435817856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.504063:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435817856:12345-0@lo:400:kworker.0 Request processed in 4130us (4525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.504078:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1787583041.504121:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583041.508370:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787583041.508397:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435817344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.508489:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435817344:12345-0@lo:400:kworker.0 Request processed in 106us (8999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.508496:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787583041.508542:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787583041.508549:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435818496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787583041.508574:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787583041.508607:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435818496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (8899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.508612:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787583041.508632:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435816960 00000100:00100000:3.0:1787583041.508640:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435816960 00000100:00100000:3.0:1787583041.508665:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435817472 00000100:00100000:3.0:1787583041.508668:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435817472 00000100:00100000:3.0:1787583041.508726:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435817984 00000100:00100000:3.0:1787583041.508730:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435817984 00000100:00100000:3.0:1787583041.508748:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787583041.508759:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435816960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.508793:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435816960:12345-0@lo:400:kworker.0 Request processed in 34us (9177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.508799:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787583041.508812:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787583041.508818:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435817472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.508858:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435817472:12345-0@lo:400:kworker.0 Request processed in 28us (9194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.508864:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787583041.508874:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787583041.508880:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435817984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583041.508893:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435818368:12345-0@lo:400:kworker.0 Request processed in 8759us (9325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583041.508902:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787583041.508908:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435817984:12345-0@lo:400:kworker.0 Request processed in 29us (9227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.508912:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787583041.508956:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435816832 00000100:00100000:3.0:1787583041.508960:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435816832 00000100:00100000:3.0:1787583041.508985:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787583041.508991:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435816832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583041.509023:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435816832:12345-0@lo:400:kworker.0 Request processed in 33us (9587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.509028:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:3.0:1787583041.509063:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787583041.509360:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435817088:12345-0@lo:400:kworker.0 Request processed in 9559us (11268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583041.509368:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787583041.509411:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435817088:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.509435:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583041.509445:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435818624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787583041.509479:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583041.509521:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435816960:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.509533:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435817472:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.509542:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435817984:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.509567:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435818496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583041.509576:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435816832:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.509583:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435817344:0@lo:400:kworker.0 00010000:00080000:1.0:1787583041.509597:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245891880 x1874416435817856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583041.509607:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435817856:0@lo:400:kworker.0 00010000:00080000:1.0:1787583041.509616:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936d83aa00 x1874416435818368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583041.509623:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435818368:0@lo:400:kworker.0 00000100:00100000:1.0:1787583041.509657:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435818624 00000100:00100000:1.0:1787583041.509660:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435818624 00000100:00100000:1.0:1787583041.509685:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787583041.509691:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435818624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787583041.509708:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583041.509755:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435818624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583041.509761:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1787583041.509791:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f1c4700 x1874416435818624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583041.509803:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435818624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787583041.938289:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583041.998580:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435818752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583041.998670:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583041.999183:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435818752 00000100:00100000:3.0:1787583041.999191:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435818752 00000100:00100000:3.0:1787583041.999243:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787583041.999253:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435818752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787583041.999275:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583041.999327:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435818752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583041.999334:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1787583041.999374:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936d839180 x1874416435818752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583041.999394:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435818752:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1787583042.311175:0:12611:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787583042.311417:0:12611:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787583042.964656:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583043.989477:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583044.373532:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583044.373563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583044.373591:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583044.373618:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583044.373636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583044.373669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583044.373690:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583044.373716:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413721088 00000100:00100000:3.0:1787583044.373725:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413721088 00000100:00100000:3.0:1787583044.373775:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413721216 00000100:00100000:3.0:1787583044.373779:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413721216 00000100:00100000:3.0:1787583044.373801:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:3.0:1787583044.373810:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413721088:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583044.373896:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413721088:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 87us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583044.373903:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:3.0:1787583044.373917:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:3.0:1787583044.373936:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413721216:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583044.373959:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413721216:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583044.373965:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:3.0:1787583044.373985:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413720448 00000100:00100000:3.0:1787583044.373988:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413720448 00000100:00100000:3.0:1787583044.374012:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 309 00000100:00100000:3.0:1787583044.374018:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2407:x1874416413720448:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583044.374042:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2407:x1874416413720448:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583044.374049:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 309 00000100:00100000:3.0:1787583044.374076:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413720576 00000100:00100000:3.0:1787583044.374080:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413720576 00000100:00100000:3.0:1787583044.374100:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413720832 00000100:00100000:3.0:1787583044.374109:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413720832 00000100:00100000:3.0:1787583044.374125:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413720704 00000100:00100000:3.0:1787583044.374127:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413720704 00000100:00100000:3.0:1787583044.374139:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413720960 00000100:00100000:3.0:1787583044.374141:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413720960 00000100:00100000:3.0:1787583044.374155:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 160 00000100:00100000:3.0:1787583044.374161:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413720576:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583044.374188:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413720576:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583044.374194:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 160 00000100:00100000:3.0:1787583044.374205:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:3.0:1787583044.374211:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413720832:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583044.374406:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:1.0:1787583044.374415:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413720704:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583044.374443:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413720704:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583044.374448:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:1.0:1787583044.374461:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:1.0:1787583044.374466:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413720960:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583044.374487:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413720960:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583044.374492:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:3.0:1787583044.374555:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413720832:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 344us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583044.374562:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00080000:3.0:1787583044.374587:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787583044.374590:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787583044.374593:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787583044.374595:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:3.0:1787583044.440729:0:12708:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787583044.441120:0:12708:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787583044.559216:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787583044.559242:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435818880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583044.559314:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583044.560500:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435818880 00000100:00100000:1.0:1787583044.560513:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435818880 00000100:00100000:1.0:1787583044.560569:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787583044.560579:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435818880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787583044.560613:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787583044.560687:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435818880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583044.560694:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787583044.560743:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435818880:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787583045.005945:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583045.582145:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435819008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583045.582217:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583045.582427:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787583045.582436:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435819136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583045.582475:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583045.582606:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435819008 00000100:00100000:2.0:1787583045.582613:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435819008 00000100:00100000:2.0:1787583045.582661:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435819136 00000100:00100000:2.0:1787583045.582665:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435819136 00000100:00100000:2.0:1787583045.582685:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787583045.582694:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435819008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787583045.582721:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583045.582778:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435819008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583045.582784:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787583045.582799:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787583045.582805:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435819136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583045.582814:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583045.582881:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435819136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583045.582888:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1787583045.582901:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092476e0700 x1874416435819008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583045.582933:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435819008:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787583045.582969:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787583045.582992:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc88e00 x1874416435819136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583045.583007:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435819136:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787583046.034529:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787583046.329807:0:12805:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787583046.331012:0:12805:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787583046.606235:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787583046.606261:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435819648:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.606336:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583046.606367:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435819392:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.606403:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435819648 00000100:00100000:2.0:1787583046.606408:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583046.606412:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435819648 00000100:00100000:2.0:1787583046.606464:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435819904:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.606467:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787583046.606482:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435819648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583046.606495:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583046.606518:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435820416:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.606539:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435819648:12345-0@lo:400:kworker.0 Request processed in 59us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583046.606546:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787583046.606550:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583046.606568:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435819904 00000100:00100000:3.0:1787583046.606572:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435819904 00000100:00100000:2.0:1787583046.606573:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435820928:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.606594:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787583046.606605:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435819904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583046.606606:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583046.606633:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787583046.606642:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435819520:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.606649:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435819904:12345-0@lo:400:kworker.0 Request processed in 45us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583046.606655:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787583046.606673:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583046.606677:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435819392 00000100:00100000:3.0:1787583046.606682:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435819392 00000100:00100000:2.0:1787583046.606693:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435820032:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.606709:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787583046.606716:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435819392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583046.606730:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583046.606749:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435820544:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.606777:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435819392:12345-0@lo:400:kworker.0 Request processed in 61us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583046.606783:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583046.606792:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787583046.606824:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435819392:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.606834:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435820416 00000100:00100000:3.0:1787583046.606839:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435820416 00000100:00100000:2.0:1787583046.606841:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435819904:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.606918:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435820928 00000100:00100000:2.0:1787583046.606922:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435819648:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.606923:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435820928 00000100:00100000:2.0:1787583046.606932:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435819264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583046.606956:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787583046.606965:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435820416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583046.606972:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583046.607007:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435820160:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.607014:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435820416:12345-0@lo:400:kworker.0 Request processed in 48us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583046.607020:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787583046.607034:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787583046.607039:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583046.607044:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435820928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583046.607065:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435820672:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.607076:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435820928:12345-0@lo:400:kworker.0 Request processed in 33us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583046.607082:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787583046.607093:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583046.607110:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435819520 00000100:00100000:2.0:1787583046.607110:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787583046.607116:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435819520 00000100:00100000:2.0:1787583046.607119:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435819776:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.607140:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435820032 00000100:00100000:3.0:1787583046.607145:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435820032 00000100:00100000:2.0:1787583046.607145:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583046.607162:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435820544 00000100:00100000:2.0:1787583046.607162:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435820288:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.607167:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435820544 00000100:00100000:3.0:1787583046.607187:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435820160 00000100:00100000:3.0:1787583046.607191:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435820160 00000100:00100000:2.0:1787583046.607195:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583046.607204:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435820672 00000100:00100000:3.0:1787583046.607208:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435820672 00000100:00100000:2.0:1787583046.607217:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435820800:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.607220:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435819776 00000100:00100000:3.0:1787583046.607224:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435819776 00000100:00100000:2.0:1787583046.607242:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583046.607256:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787583046.607265:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435819520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583046.607301:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435820288 00000100:00100000:3.0:1787583046.607303:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435819520:12345-0@lo:400:kworker.0 Request processed in 39us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583046.607306:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435820288 00000100:00100000:3.0:1787583046.607313:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787583046.607333:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435820800 00000100:00100000:3.0:1787583046.607334:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787583046.607338:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435820800 00000100:00100000:3.0:1787583046.607345:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435820032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583046.607360:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787583046.607369:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435820288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.607379:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435820032:12345-0@lo:400:kworker.0 Request processed in 35us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583046.607386:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787583046.607401:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787583046.607409:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435820544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583046.607415:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435820288:12345-0@lo:400:kworker.0 Request processed in 47us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583046.607424:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787583046.607440:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787583046.607450:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435820800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.607455:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435820544:12345-0@lo:400:kworker.0 Request processed in 45us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583046.607463:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787583046.607481:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787583046.607491:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435820800:12345-0@lo:400:kworker.0 Request processed in 42us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583046.607492:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435820160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583046.607506:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1787583046.607534:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787583046.607535:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435820160:12345-0@lo:400:kworker.0 Request processed in 47us (497us total) trans 0 rc 0/0 00000100:00080000:2.0:1787583046.607539:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583046.607544:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583046.607545:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787583046.607562:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787583046.607839:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435820672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583046.607898:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435820672:12345-0@lo:400:kworker.0 Request processed in 329us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583046.610978:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787583046.611007:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435819776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.611096:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435819776:12345-0@lo:400:kworker.0 Request processed in 106us (3950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583046.611106:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787583046.611179:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435819264 00000100:00100000:3.0:1787583046.611186:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435819264 00000100:00100000:3.0:1787583046.611226:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787583046.611233:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435819264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787583046.611258:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787583046.611292:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435819264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (4321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583046.611299:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787583046.611346:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435819520:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.611359:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435820032:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.611371:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435820544:0@lo:400:kworker.0 00010000:00080000:3.0:1787583046.611385:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc88a80 x1874416435820416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583046.611396:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435820416:0@lo:400:kworker.0 00010000:00080000:3.0:1787583046.611407:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247677100 x1874416435820928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583046.611416:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435820928:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.611478:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435819776:0@lo:400:kworker.0 00010000:00080000:3.0:1787583046.611490:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc88700 x1874416435820288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583046.611498:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435820288:0@lo:400:kworker.0 00010000:00080000:3.0:1787583046.611509:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc8a680 x1874416435820800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583046.611530:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435820800:0@lo:400:kworker.0 00010000:00080000:3.0:1787583046.611543:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc89180 x1874416435820160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583046.611551:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435820160:0@lo:400:kworker.0 00010000:00080000:3.0:1787583046.611561:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc8a300 x1874416435820672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583046.611569:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435820672:0@lo:400:kworker.0 00000100:00100000:3.0:1787583046.611585:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435819264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583046.611654:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787583046.611666:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435821056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583046.611701:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583046.611734:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435821056 00000100:00100000:3.0:1787583046.611738:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435821056 00000100:00100000:3.0:1787583046.611766:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787583046.611774:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435821056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787583046.611792:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583046.611826:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435821056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583046.611832:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1787583046.611895:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245890380 x1874416435821056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583046.611920:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435821056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583046.615494:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00010000:3.0:1787583047.054078:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583047.118093:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435821184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583047.118161:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583047.118285:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435821184 00000100:00100000:1.0:1787583047.118293:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435821184 00000100:00100000:1.0:1787583047.118344:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787583047.118361:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435821184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787583047.118384:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583047.118559:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435821184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 198us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583047.118566:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1787583047.125109:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245890380 x1874416435821184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583047.125139:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435821184:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787583048.078169:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787583048.260630:0:12903:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787583048.260872:0:12903:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787583049.102600:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583049.486743:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583049.486796:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583049.486824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583049.486901:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583049.486917:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583049.486937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583049.486959:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413721600 00000100:00100000:0.0:1787583049.486968:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413721600 00000100:00100000:0.0:1787583049.487010:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413721856 00000100:00100000:0.0:1787583049.487012:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413721856 00000100:00100000:0.0:1787583049.487022:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413721472 00000100:00100000:0.0:1787583049.487024:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413721472 00000100:00100000:0.0:1787583049.487033:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413721728 00000100:00100000:0.0:1787583049.487035:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413721728 00000100:00100000:0.0:1787583049.487050:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 170 00000100:00100000:0.0:1787583049.487072:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413721600:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583049.487138:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413721600:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583049.487146:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 170 00000100:00100000:0.0:1787583049.487174:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:0.0:1787583049.487181:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2405:x1874416413721856:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583049.487204:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2405:x1874416413721856:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583049.487211:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:0.0:1787583049.487222:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:0.0:1787583049.487228:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2405:x1874416413721472:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583049.487250:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2405:x1874416413721472:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583049.487255:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:0.0:1787583049.487266:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:0.0:1787583049.487271:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2405:x1874416413721728:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583049.487292:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2405:x1874416413721728:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 20us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583049.487297:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:2.0:1787583049.487382:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413721984 00000100:00100000:2.0:1787583049.487387:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413721984 00000100:00100000:2.0:1787583049.487422:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:2.0:1787583049.487429:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2403:x1874416413721984:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:2.0:1787583049.487446:0:8442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b628d 00000100:00080000:2.0:1787583049.487454:0:8442:0:(import.c:65:import_set_state_nolock()) ffff90937fb92800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787583049.487492:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787583049.487610:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b124cdab-8363-4433-96a8-2d8722f1634b+2:2403:x1874416413721984:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 182us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583049.487617:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00080000:2.0:1787583049.487635:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787583049.487639:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583049.487641:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787583049.487655:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583049.488028:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413721344 00000100:00100000:3.0:1787583049.488033:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413721344 00000100:00100000:2.0:1787583049.488191:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583049.488305:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413722112 00000100:00100000:2.0:1787583049.488310:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413722112 00000100:00100000:2.0:1787583049.488341:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:2.0:1787583049.488348:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2403:x1874416413722112:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:2.0:1787583049.488364:0:8444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6294 00000100:00080000:2.0:1787583049.488370:0:8444:0:(import.c:65:import_set_state_nolock()) ffff90937fc57000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787583049.488396:0:8444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787583049.488504:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b124cdab-8363-4433-96a8-2d8722f1634b+2:2403:x1874416413722112:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 156us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583049.488510:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00010000:00010000:2.0:1787583049.488527:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787583049.488533:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787583049.489485:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 311 00000100:00100000:2.0:1787583049.489500:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2405:x1874416413721344:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583049.489562:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2405:x1874416413721344:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 67us (2766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583049.489568:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 311 00000100:00100000:2.0:1787583049.679995:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435821312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787583049.680065:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583049.680218:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435821312 00000100:00100000:1.0:1787583049.680226:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435821312 00000100:00100000:1.0:1787583049.680279:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787583049.680289:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435821312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787583049.680321:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787583049.680367:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435821312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583049.680373:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787583049.680653:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435821312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787583050.126693:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583050.703429:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787583050.703453:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435821440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787583050.703521:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583050.703696:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435821440 00000100:00100000:1.0:1787583050.703704:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435821440 00000100:00100000:1.0:1787583050.703767:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787583050.703779:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435821440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787583050.703807:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583050.703919:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435821440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583050.703927:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1787583050.703979:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092476e3100 x1874416435821440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583050.704000:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435821440:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787583050.704116:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583050.706039:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787583050.706062:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435821568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583050.706132:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583050.706302:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435821568 00000100:00100000:0.0:1787583050.706310:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435821568 00000100:00100000:0.0:1787583050.706376:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787583050.706387:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435821568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787583050.706408:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787583050.706467:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435821568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583050.706474:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1787583050.706512:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f2b6300 x1874416435821568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583050.706530:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435821568:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787583050.706643:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787583051.150197:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583051.730184:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435821952:0@lo:400:kworker.0 00000100:00100000:1.0:1787583051.730206:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435822080:0@lo:400:kworker.0 00000100:00100000:1.0:1787583051.730260:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583051.730262:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583051.730383:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435822592:0@lo:400:kworker.0 00000100:00100000:2.0:1787583051.730710:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435821696:0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.730795:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435822464:0@lo:400:kworker.0 00000100:00100000:1.0:1787583051.730802:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583051.730828:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583051.730842:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435823104:0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.730892:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435822976:0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.730914:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583051.730960:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435822080 00000100:00100000:0.0:1787583051.730967:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435822080 00000100:00100000:1.0:1787583051.731057:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583051.731294:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435822464 00000100:00100000:0.0:1787583051.731299:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435822464 00000100:00100000:0.0:1787583051.731323:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435822976 00000100:00100000:0.0:1787583051.731326:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435822976 00000100:00100000:0.0:1787583051.731343:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787583051.731351:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435822080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.731417:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435822080:12345-0@lo:400:kworker.0 Request processed in 65us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583051.731424:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787583051.731441:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787583051.731447:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435822464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.731491:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435822464:12345-0@lo:400:kworker.0 Request processed in 44us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583051.731497:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787583051.731509:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787583051.731515:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435822976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.731551:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435822976:12345-0@lo:400:kworker.0 Request processed in 37us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583051.731557:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787583051.731576:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435821952 00000100:00100000:0.0:1787583051.731581:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435821952 00000100:00100000:0.0:1787583051.731605:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787583051.731611:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435821952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.731643:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435821952:12345-0@lo:400:kworker.0 Request processed in 32us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583051.731649:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1787583051.731686:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787583051.731715:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924667f100 x1874416435822976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583051.731728:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435822976:0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.731737:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435821952:0@lo:400:kworker.0 00010000:00080000:0.0:1787583051.731745:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247c9ea00 x1874416435822464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583051.731752:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435822464:0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.731780:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435822080:0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.732066:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435821824:0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.732096:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583051.732115:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435822336:0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.732135:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583051.732157:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435822848:0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.732179:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583051.732206:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435821824 00000100:00100000:0.0:1787583051.732210:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435821824 00000100:00100000:0.0:1787583051.732235:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435822336 00000100:00100000:0.0:1787583051.732239:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435822336 00000100:00100000:0.0:1787583051.732259:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435822848 00000100:00100000:0.0:1787583051.732262:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435822848 00000100:00100000:0.0:1787583051.732274:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787583051.732280:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435821824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.732315:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435821824:12345-0@lo:400:kworker.0 Request processed in 35us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583051.732321:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787583051.732334:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787583051.732353:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435822336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.732379:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435822336:12345-0@lo:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583051.732385:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787583051.732612:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787583051.732620:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435822848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.732652:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435822848:12345-0@lo:400:kworker.0 Request processed in 34us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583051.732729:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:0.0:1787583051.732808:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787583051.732837:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435821824:0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.732880:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435822336:0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.732892:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435822848:0@lo:400:kworker.0 00000100:00100000:3.0:1787583051.732911:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435822592 00000100:00100000:3.0:1787583051.732917:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435822592 00000100:00100000:3.0:1787583051.732954:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435823104 00000100:00100000:3.0:1787583051.732958:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435823104 00000100:00100000:3.0:1787583051.732984:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787583051.732991:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435822592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583051.733032:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435822592:12345-0@lo:400:kworker.0 Request processed in 42us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583051.733038:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787583051.733050:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787583051.733056:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435823104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583051.733086:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435823104:12345-0@lo:400:kworker.0 Request processed in 31us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583051.733093:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1787583051.733174:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583051.733184:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435823488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583051.733213:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583051.733242:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435823488 00000100:00100000:3.0:1787583051.733246:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435823488 00000100:00100000:0.0:1787583051.733608:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435823360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787583051.733640:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583051.733670:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435823360 00000100:00100000:0.0:1787583051.733673:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435823360 00000100:00100000:0.0:1787583051.733706:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787583051.733712:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435823360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583051.733723:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787583051.733735:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583051.733752:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435822208:0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.733769:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435823360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583051.733772:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583051.733776:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787583051.733788:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435822720:0@lo:400:kworker.0 00010000:00080000:0.0:1787583051.733804:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc8a300 x1874416435823360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583051.733807:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583051.733820:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435823360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583051.733821:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435823232:0@lo:400:kworker.0 00000100:00100000:2.0:1787583051.733838:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583051.733882:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435822720 00000100:00100000:0.0:1787583051.733886:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435822720 00000100:00100000:0.0:1787583051.733906:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435823232 00000100:00100000:0.0:1787583051.733909:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435823232 00000100:00100000:0.0:1787583051.733919:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787583051.733925:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435822720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.733968:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435822720:12345-0@lo:400:kworker.0 Request processed in 43us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583051.733975:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787583051.733985:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787583051.733991:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435823232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583051.734013:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435823232:12345-0@lo:400:kworker.0 Request processed in 24us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583051.734019:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787583051.734435:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435822208 00000100:00100000:3.0:1787583051.734440:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435822208 00000100:00100000:3.0:1787583051.734459:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787583051.734474:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435823488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787583051.734498:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787583051.734537:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435823488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583051.734542:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787583051.734553:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787583051.734558:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435822208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583051.734584:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435822208:12345-0@lo:400:kworker.0 Request processed in 25us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583051.734589:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787583051.734610:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435821696 00000100:00100000:3.0:1787583051.734614:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435821696 00000100:00100000:3.0:1787583051.734636:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787583051.734642:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435821696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583051.734669:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435821696:12345-0@lo:400:kworker.0 Request processed in 28us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583051.734674:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00080000:3.0:1787583051.734704:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583051.734728:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435823488:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1787583051.734759:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247c9f800 x1874416435822592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583051.734769:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435822592:0@lo:400:kworker.0 00010000:00080000:3.0:1787583051.734780:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924667ed80 x1874416435823104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583051.734788:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435823104:0@lo:400:kworker.0 00000100:00100000:2.0:1787583051.735827:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435821696:0@lo:400:kworker.0 00000100:00100000:2.0:1787583051.735840:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435822208:0@lo:400:kworker.0 00010000:00080000:2.0:1787583051.735879:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924667d180 x1874416435822720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583051.735889:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435822720:0@lo:400:kworker.0 00010000:00080000:2.0:1787583051.735900:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b63800 x1874416435823232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583051.735908:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435823232:0@lo:400:kworker.0 00000001:02000400:0.0:1787583051.814312:0:13048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787583052.174079:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583052.243574:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787583052.243606:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435823616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583052.243692:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583052.243897:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435823616 00000100:00100000:2.0:1787583052.243906:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435823616 00000100:00100000:2.0:1787583052.244770:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787583052.244783:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435823616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583052.244807:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583052.244908:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435823616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583052.244932:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1787583052.245016:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc89180 x1874416435823616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583052.245037:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435823616:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787583053.200201:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583054.222290:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583054.613527:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583054.615891:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583054.616539:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413722368 00000100:00100000:0.0:1787583054.616559:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413722368 00000100:00100000:3.0:1787583054.616575:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583054.616605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583054.616811:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413722624 00000100:00100000:0.0:1787583054.616815:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413722624 00000100:00100000:0.0:1787583054.616836:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413722496 00000100:00100000:0.0:1787583054.616838:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413722496 00000100:00100000:0.0:1787583054.616886:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:0.0:1787583054.616897:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413722368:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583054.616921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00080000:3.0:1787583054.616937:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787583054.616940:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787583054.616951:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413722240 00000100:00100000:3.0:1787583054.616956:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413722240 00000100:00100000:3.0:1787583054.616988:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 313 00000100:00100000:3.0:1787583054.616996:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413722240:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583054.617032:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413722752 00000100:00100000:1.0:1787583054.617039:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413722752 00000100:00100000:3.0:1787583054.617046:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413722240:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 50us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583054.617055:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 313 00000100:00100000:1.0:1787583054.617089:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:0.0:1787583054.617099:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413722368:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 202us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583054.617101:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413722624:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583054.617114:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:0.0:1787583054.617133:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:0.0:1787583054.617140:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413722496:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583054.617152:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413722624:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 53us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583054.617159:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:1.0:1787583054.617175:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:1.0:1787583054.617182:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413722752:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583054.617240:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413722496:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 100us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583054.617247:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:1.0:1787583054.617378:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413722752:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 196us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583054.617400:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00080000:3.0:1787583054.619807:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787583054.799487:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435823744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787583054.799560:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583054.799999:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435823744 00000100:00100000:0.0:1787583054.800014:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435823744 00000100:00100000:0.0:1787583054.800067:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787583054.800077:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435823744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787583054.800110:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787583054.800169:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435823744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583054.800176:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787583054.800478:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435823744:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1787583054.803309:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b124cdab-8363-4433-96a8-2d8722f1634b 00000020:00000080:2.0:1787583054.803318:0:9523:0:(genops.c:885:class_export_put()) final put ffff90937fc53000/b124cdab-8363-4433-96a8-2d8722f1634b 00000020:00000080:1.0:1787583054.803543:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90937fc53000/b124cdab-8363-4433-96a8-2d8722f1634b for lustre-OST0001 00000001:00100000:0.0:1787583054.803583:0:8437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b124cdab-8363-4433-96a8-2d8722f1634b 00000020:00000080:0.0:1787583054.803588:0:8437:0:(genops.c:885:class_export_put()) final put ffff90937fb94800/b124cdab-8363-4433-96a8-2d8722f1634b 00000020:00000080:1.0:1787583054.803605:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90937fc57000 for lustre-OST0001 00000020:00000080:1.0:1787583054.803612:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90937fb94800/b124cdab-8363-4433-96a8-2d8722f1634b for lustre-OST0000 00000020:00000080:1.0:1787583054.803635:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90937fb92800 for lustre-OST0000 00000020:00000080:0.0:1787583055.043562:0:13195:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee583d1e0 20000000:00000080:0.0:1787583055.043581:0:13195:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90936f140c00 uarg=0000000000000000 20000000:01000000:0.0:1787583055.043624:0:13195:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787583055.043631:0:13195:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787583055.043636:0:13195:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787583055.044208:0:13196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787583055.044284:0:13195:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787583055.060155:0:13195:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787583055.062116:0:13195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062141:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367f400/0x19a47956376b6232 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b622b expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062149:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924713f800/0x19a47956376b6240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6239 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062155:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924713f600/0x19a47956376b624e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6247 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062162:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924770a600/0x19a47956376b625c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6255 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062171:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909344dede00/0x19a47956376b6263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40a4 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062178:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924770b600/0x19a47956376b6278 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40e3 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062186:0:13195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062249:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924770b600/0x19a47956376b6278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40e3 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062263:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90924770b600/0x19a47956376b6278 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40e3 expref: 12 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583055.062279:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1874416435823872:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583055.062380:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909344dede00/0x19a47956376b6263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40a4 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062389:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff909344dede00/0x19a47956376b6263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40a4 expref: 12 pid: 6522 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583055.062412:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1874416435824000:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583055.062446:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924770a600/0x19a47956376b625c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b6255 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062455:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90924770a600/0x19a47956376b625c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b6255 expref: 23 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583055.062464:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1874416435824128:0@lo:104: 00000100:00100000:1.0:1787583055.062500:0:13195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787583055.062531:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924713f600/0x19a47956376b624e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b6247 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062539:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90924713f600/0x19a47956376b624e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b6247 expref: 23 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583055.062558:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1874416435824256:0@lo:104: 00000100:00100000:1.0:1787583055.062578:0:13195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787583055.062603:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924713f800/0x19a47956376b6240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b6239 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062611:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90924713f800/0x19a47956376b6240 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b6239 expref: 23 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583055.062618:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1874416435824384:0@lo:104: 00000100:00100000:1.0:1787583055.062638:0:13195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787583055.062654:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367f400/0x19a47956376b6232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b622b expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062661:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90936367f400/0x19a47956376b6232 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b622b expref: 23 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583055.062669:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1874416435824512:0@lo:104: 00000100:00100000:1.0:1787583055.062689:0:13195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583055.062699:0:13195:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583055.062735:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435824128 00000100:00100000:1.0:1787583055.062742:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435824128 00000100:00100000:1.0:1787583055.062776:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435824256 00000100:00100000:1.0:1787583055.062779:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435824256 00000100:00100000:1.0:1787583055.062788:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435824384 00000100:00100000:1.0:1787583055.062791:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435824384 00000100:00100000:1.0:1787583055.062800:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435824512 00000100:00100000:1.0:1787583055.062802:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435824512 00000100:00100000:1.0:1787583055.062814:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787583055.062822:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+6:13195:x1874416435824128:12345-0@lo:104: 00010000:00010000:1.0:1787583055.062840:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b625c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.062937:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787583055.062943:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+6:13195:x1874416435824128:12345-0@lo:104: Request processed in 122us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583055.062950:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787583055.062969:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787583055.062975:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:13195:x1874416435824256:12345-0@lo:104: 00010000:00010000:1.0:1787583055.062982:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b624e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.063012:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787583055.063018:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+5:13195:x1874416435824256:12345-0@lo:104: Request processed in 43us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583055.063024:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787583055.063036:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787583055.063042:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:13195:x1874416435824384:12345-0@lo:104: 00010000:00010000:1.0:1787583055.063048:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b6240 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.063073:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787583055.063077:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+4:13195:x1874416435824384:12345-0@lo:104: Request processed in 36us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583055.063082:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787583055.063092:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787583055.063097:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:13195:x1874416435824512:12345-0@lo:104: 00010000:00010000:0.0:1787583055.063104:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787583055.063110:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b6232 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583055.063111:0:10405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b625c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583055.063118:0:10405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583055.063122:0:10405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b625c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583055.063130:0:10405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b625c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.063140:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787583055.063144:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+3:13195:x1874416435824512:12345-0@lo:104: Request processed in 47us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583055.063150:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1787583055.063167:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787583055.063171:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b624e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.063177:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787583055.063181:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b624e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.063187:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b624e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787583055.063194:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b624e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583055.063199:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787583055.063224:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b624e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.063231:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787583055.063250:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b624e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583055.063250:0:10405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b625c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.063257:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924713e600/0x19a47956376b6247 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b624e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583055.063257:0:10405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787583055.063273:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787583055.063276:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b6240 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583055.063277:0:10405:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b625c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.063282:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344decc00 already unused, calling callback (ffffffffc118ec20) 00010000:00010000:0.0:1787583055.063283:0:10405:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1787583055.063285:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b6240 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.063291:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b6240 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787583055.063298:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b6240 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583055.063298:0:10405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b625c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583055.063303:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787583055.063305:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924770b400/0x19a47956376b6255 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b625c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583055.063313:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787583055.063315:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6240 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583055.063317:0:10405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b6232 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.063321:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787583055.063323:0:10405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344deda00 already unused, calling callback (ffffffffc118ec20) 00010000:00010000:1.0:1787583055.063326:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6240 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583055.063326:0:10405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b6232 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.063334:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b6239 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6240 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583055.063334:0:10405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b6232 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583055.063341:0:10405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b6232 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.063343:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583055.063345:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583055.063347:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787583055.063347:0:10405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787583055.063356:0:10405:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6232 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583055.063359:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435824640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787583055.063361:0:10405:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787583055.063366:0:10405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6232 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583055.063380:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b622b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b6232 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583055.063388:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787583055.063393:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583055.063394:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583055.063395:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583055.063405:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435824896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583055.063416:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583055.063422:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435825024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583055.063430:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583055.063446:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435824768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787583055.064999:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583055.065023:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583055.069338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435824640 00000100:00100000:3.0:1787583055.069352:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435824640 00010000:00010000:3.0:1787583055.069414:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924713f600/0x19a47956376b624e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b6247 expref: 24 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583055.069447:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435824896 00000100:00100000:3.0:1787583055.069451:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435824896 00010000:00010000:3.0:1787583055.069577:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924713f800/0x19a47956376b6240 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b6239 expref: 25 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583055.069598:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787583055.069608:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+25:3654:x1874416435824640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787583055.069623:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583055.069645:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924713f600/0x19a47956376b624e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b6247 expref: 25 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583055.069656:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924713f600/0x19a47956376b624e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b6247 expref: 25 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583055.069758:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583055.070435:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1874416435824128:0@lo:104: 00010000:00010000:2.0:1787583055.070451:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713f600/0x19a47956376b624e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b6247 expref: 25 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583055.070466:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1874416435824256:0@lo:104: 00000100:00100000:2.0:1787583055.070475:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1874416435824384:0@lo:104: 00000100:00100000:2.0:1787583055.070484:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1874416435824512:0@lo:104: 00000100:00100000:0.0:1787583055.070583:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787583055.070664:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435824896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787583055.070676:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583055.070682:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924713f800/0x19a47956376b6240 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b6239 expref: 24 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583055.070692:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924713f800/0x19a47956376b6240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b6239 expref: 24 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583055.070704:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713f800/0x19a47956376b6240 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b6239 expref: 24 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583055.070713:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583055.070808:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:3656:x1874416435824896:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (7375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583055.070815:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787583055.070968:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435824896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787583055.071081:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:3654:x1874416435824640:12345-0@lo:103:ldlm_bl.0 Request processed in 1474us (7690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583055.071088:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787583055.071317:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583055.071345:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413722880 00000100:00100000:3.0:1787583055.071351:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413722880 00010000:00010000:3.0:1787583055.071372:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924770b600/0x19a47956376b6278 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40e3 expref: 13 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583055.071395:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:3.0:1787583055.071403:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa77711a-a697-4098-9892-32db59b6905c+13:2407:x1874416413722880:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583055.071411:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583055.071416:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924770b600/0x19a47956376b6278 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40e3 expref: 13 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583055.071426:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924770b600/0x19a47956376b6278 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40e3 expref: 13 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583055.071439:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583055.071475:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa77711a-a697-4098-9892-32db59b6905c+13:2407:x1874416413722880:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 73us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583055.071482:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:1.0:1787583055.071552:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583055.071589:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435824768 00000100:00100000:1.0:1787583055.071593:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435824768 00010000:00010000:1.0:1787583055.071609:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924770a600/0x19a47956376b625c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b6255 expref: 22 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583055.071630:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787583055.071636:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:3655:x1874416435824768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583055.071643:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583055.071647:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924770a600/0x19a47956376b625c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b6255 expref: 22 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.071654:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924770a600/0x19a47956376b625c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b6255 expref: 22 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.071663:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924770a600/0x19a47956376b625c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b6255 expref: 22 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.071678:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583055.071707:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:3655:x1874416435824768:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583055.071713:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787583055.071726:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435824768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583055.071731:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583055.071755:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435824640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583055.071778:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435825024 00000100:00100000:1.0:1787583055.071782:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435825024 00010000:00010000:1.0:1787583055.071794:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367f400/0x19a47956376b6232 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b622b expref: 21 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583055.071818:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787583055.071823:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+21:3654:x1874416435825024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583055.071833:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583055.071837:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367f400/0x19a47956376b6232 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b622b expref: 21 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.071871:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367f400/0x19a47956376b6232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b622b expref: 21 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.071883:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367f400/0x19a47956376b6232 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b622b expref: 21 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.071891:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583055.071919:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+20:3654:x1874416435825024:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583055.071925:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787583055.071947:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435825024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787583055.072273:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924770b600/0x19a47956376b6278 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40e3 expref: 12 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583055.072283:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1874416435823872:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583055.072292:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1874416435824000:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583055.072320:0:13195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583055.078955:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583055.079021:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413723008 00000100:00100000:1.0:1787583055.079031:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413723008 00010000:00010000:1.0:1787583055.079080:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909344dede00/0x19a47956376b6263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40a4 expref: 12 pid: 6522 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583055.079116:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:1.0:1787583055.079126:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373f51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa77711a-a697-4098-9892-32db59b6905c+12:2404:x1874416413723008:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583055.079166:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583055.079173:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909344dede00/0x19a47956376b6263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40a4 expref: 12 pid: 6522 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.079187:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909344dede00/0x19a47956376b6263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40a4 expref: 12 pid: 6522 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.079205:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344dede00/0x19a47956376b6263 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40a4 expref: 12 pid: 6522 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.079223:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.079230:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.079247:0:8470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.079254:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.079260:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.079267:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.079273:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e000 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787583055.079278:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.079297:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.079319:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583055.079330:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583055.079386:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373f51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa77711a-a697-4098-9892-32db59b6905c+11:2404:x1874416413723008:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 260us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583055.079393:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00010000:00010000:2.0:1787583055.079819:0:13195:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583055.079829:0:13195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583055.079835:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367e000/0x19a47956376b629b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583055.246980:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583055.823457:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787583055.823481:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435825152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583055.823545:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583055.823967:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787583055.823979:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435825280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787583055.824013:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583055.824737:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435825152 00000100:00100000:2.0:1787583055.824746:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435825152 00000100:00100000:2.0:1787583055.824800:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435825280 00000100:00100000:2.0:1787583055.824803:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435825280 00000100:00100000:2.0:1787583055.824821:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787583055.824831:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435825152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583055.824899:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583055.824956:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435825152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583055.824962:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787583055.824981:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787583055.824987:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435825280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787583055.824997:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583055.825025:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435825280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583055.825030:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1787583055.825123:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787583055.825164:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc88e00 x1874416435825280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583055.825184:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435825280:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787583055.825511:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f2b6300 x1874416435825152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583055.825527:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435825152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787583056.269976:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787583056.335085:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787583056.335091:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936db2f000 from 7 10000000:01000000:3.0:1787583056.335095:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787583056.335143:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583056.335155:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583056.335166:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583056.335203:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435825408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787583056.335269:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583056.335320:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365f5b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787583056.336133:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435825408 00000100:00100000:1.0:1787583056.336143:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435825408 00000100:00100000:1.0:1787583056.336197:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787583056.336207:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435825408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583056.336222:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583056.336238:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367f800/0x19a47956376b62a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b62a2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.336262:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367f800/0x19a47956376b62a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b62a2 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.336272:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367f800/0x19a47956376b62a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b62a2 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.336281:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367f800, rc 0) 00000100:00100000:1.0:1787583056.336335:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435825408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.336342:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787583056.336401:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435825408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583056.336418:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b62a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.336427:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b62a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583056.336492:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435825536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.336518:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.336542:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787583056.336554:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435825536 00000100:00100000:1.0:1787583056.336558:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435825536 00000100:00100000:1.0:1787583056.336580:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787583056.336586:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435825536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.336704:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435825536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.336711:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787583056.336740:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435825536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.336768:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435825664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.336809:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.336824:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787583056.336870:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435825664 00000100:00100000:1.0:1787583056.336874:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435825664 00000100:00100000:1.0:1787583056.336893:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787583056.336898:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093749e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435825664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.336976:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093749e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435825664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.336989:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787583056.337031:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435825664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787583056.337702:0:13224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787583056.337762:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787583056.337777:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787583056.337785:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b62a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.337795:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b62a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583056.337805:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787583056.337807:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936d948800 from 7 10000000:01000000:1.0:1787583056.337809:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787583056.337834:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.337882:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.337891:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583056.337907:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435825792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.337943:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.337971:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787583056.337986:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435825792 00000100:00100000:1.0:1787583056.337991:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435825792 00000100:00100000:1.0:1787583056.338020:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787583056.338038:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093749e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435825792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583056.338048:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583056.338058:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367f400/0x19a47956376b62b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b62b0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.338078:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367f400/0x19a47956376b62b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b62b0 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.338089:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367f400/0x19a47956376b62b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b62b0 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.338097:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367f400, rc 0) 00000100:00100000:1.0:1787583056.338131:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093749e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435825792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.338137:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787583056.338172:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435825792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583056.338184:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b62b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.338191:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b62b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583056.338232:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435825920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.338255:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.338269:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787583056.338279:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435825920 00000100:00100000:1.0:1787583056.338282:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435825920 00000100:00100000:1.0:1787583056.338301:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1787583056.338313:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909345379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435825920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.338399:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909345379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435825920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.338405:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1787583056.338435:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435825920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.338459:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.338495:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.338507:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787583056.338517:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435826048 00000100:00100000:1.0:1787583056.338520:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435826048 00000100:00100000:1.0:1787583056.338540:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787583056.338545:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934537a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435826048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.338613:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934537a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435826048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.338619:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787583056.338659:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787583056.359501:0:13226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787583056.359764:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787583056.359786:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787583056.359798:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b62b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.359811:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b62b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583056.359822:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787583056.359825:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936d90b000 from 7 10000000:01000000:1.0:1787583056.359871:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787583056.359913:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.359921:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.359931:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583056.359958:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.360023:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.360063:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a1880c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583056.360229:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435826176 00000100:00100000:2.0:1787583056.360237:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435826176 00000100:00100000:2.0:1787583056.360282:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787583056.360291:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937702bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435826176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583056.360303:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583056.360314:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924770ba00/0x19a47956376b62c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b62be expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583056.360337:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924770ba00/0x19a47956376b62c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b62be expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583056.360346:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924770ba00/0x19a47956376b62c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b62be expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583056.360355:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770ba00, rc 0) 00000100:00100000:2.0:1787583056.360396:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937702bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435826176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583056.360402:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787583056.360485:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787583056.360497:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b62c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583056.360506:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b62c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583056.360562:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583056.360586:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583056.360614:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365f5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787583056.360695:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435826304 00000100:00100000:2.0:1787583056.360700:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435826304 00000100:00100000:2.0:1787583056.360735:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787583056.360741:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435826304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787583056.360871:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435826304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583056.360878:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787583056.360985:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583056.361015:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583056.361053:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583056.361068:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365f5bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787583056.361080:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435826432 00000100:00100000:3.0:1787583056.361083:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435826432 00000100:00100000:3.0:1787583056.361101:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787583056.361107:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435826432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583056.361199:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435826432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583056.361206:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787583056.361246:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787583056.361938:0:13228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787583056.361984:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787583056.361998:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787583056.362006:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b62c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583056.362017:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b62c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583056.362026:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787583056.362036:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff909348740800 from 7 10000000:01000000:3.0:1787583056.362039:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787583056.362061:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583056.362068:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583056.362076:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583056.362092:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787583056.362125:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583056.362148:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365f5b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787583056.362164:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435826560 00000100:00100000:3.0:1787583056.362167:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435826560 00000100:00100000:3.0:1787583056.362190:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787583056.362196:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937702a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435826560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787583056.362205:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583056.362215:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344dede00/0x19a47956376b62d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b62cc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583056.362231:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344dede00/0x19a47956376b62d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b62cc expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583056.362241:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344dede00/0x19a47956376b62d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b62cc expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583056.362250:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dede00, rc 0) 00000100:00100000:3.0:1787583056.362280:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937702a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435826560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583056.362292:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787583056.362326:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787583056.362337:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b62d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583056.362346:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b62d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583056.362393:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583056.362417:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583056.362440:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365f5b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787583056.363228:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435826688 00000100:00100000:1.0:1787583056.363235:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435826688 00000100:00100000:1.0:1787583056.363271:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787583056.363279:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435826688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.363395:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435826688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.363402:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787583056.363438:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.363470:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.363509:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.363525:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a188cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583056.363536:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435826816 00000100:00100000:1.0:1787583056.363540:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435826816 00000100:00100000:1.0:1787583056.363556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787583056.363563:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435826816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.363638:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435826816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.363644:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787583056.363681:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435826816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787583056.366465:0:13229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787583056.366787:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787583056.366813:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787583056.366824:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b62d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583056.366882:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b62d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583056.399971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583056.400132:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413723136 00000100:00100000:1.0:1787583056.400142:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413723136 00000100:00100000:1.0:1787583056.400199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 326 00000100:00100000:1.0:1787583056.400209:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+11:6178:x1874416413723136:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583056.400225:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583056.400241:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367f000/0x19a47956376b62da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4114 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.400265:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367f000/0x19a47956376b62da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4114 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.400275:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367f000/0x19a47956376b62da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4114 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583056.400286:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367f000, rc 0) 00000100:00100000:1.0:1787583056.400345:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+12:6178:x1874416413723136:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 136us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.400351:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 326 00000100:00100000:3.0:1787583056.418692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583056.418803:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413723264 00000100:00100000:1.0:1787583056.418814:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413723264 00000100:00100000:1.0:1787583056.418914:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 327 00000100:00100000:1.0:1787583056.418925:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+12:6178:x1874416413723264:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583056.419090:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+12:6178:x1874416413723264:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 167us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.419098:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 327 00000100:00100000:2.0:1787583056.432282:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583056.432888:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413723392 00000100:00100000:3.0:1787583056.432899:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413723392 00000100:00100000:3.0:1787583056.432959:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 328 00000100:00100000:3.0:1787583056.432969:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+12:6178:x1874416413723392:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583056.433118:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+12:6178:x1874416413723392:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 150us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583056.433127:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 328 00000100:00100000:0.0:1787583056.442314:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583056.442582:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413723520 00000100:00100000:2.0:1787583056.442592:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413723520 00000100:00100000:2.0:1787583056.442645:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 329 00000100:00100000:2.0:1787583056.442654:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+12:6178:x1874416413723520:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583056.442670:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583056.442685:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924770a800/0x19a47956376b62e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c411b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583056.442711:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924770a800/0x19a47956376b62e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c411b expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583056.442721:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924770a800/0x19a47956376b62e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c411b expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583056.442731:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a800, rc 0) 00000100:00100000:2.0:1787583056.442792:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:6178:x1874416413723520:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 138us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583056.442798:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 329 00000100:00100000:2.0:1787583056.446268:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583056.446356:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413723648 00000100:00100000:0.0:1787583056.446367:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413723648 00000100:00100000:0.0:1787583056.446415:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 330 00000100:00100000:0.0:1787583056.446426:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:6178:x1874416413723648:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787583056.446578:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:6178:x1874416413723648:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 153us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583056.446585:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 330 00000100:00100000:0.0:1787583056.450122:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583056.450201:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413723776 00000100:00100000:3.0:1787583056.450211:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413723776 00000100:00100000:3.0:1787583056.450268:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 331 00000100:00100000:3.0:1787583056.450279:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:6178:x1874416413723776:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583056.450419:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:6178:x1874416413723776:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 141us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583056.450434:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 331 00000100:00100000:1.0:1787583056.846192:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435827328:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.846264:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.846330:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435827840:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.846355:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.846376:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435828352:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.846398:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.846428:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787583056.846435:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435826944:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.846458:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.846475:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435827456:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.846495:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.846517:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435827968:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.846537:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.846560:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435827200:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.846582:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.846597:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435827712:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.846617:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.846634:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435828224:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.846654:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.846673:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787583056.846677:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435827072:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.846709:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.846745:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435827584:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.846767:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.846778:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435828096:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.846796:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583056.846821:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435827840 00000100:00100000:1.0:1787583056.846828:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435827840 00000100:00100000:1.0:1787583056.846892:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435828352 00000100:00100000:1.0:1787583056.846896:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435828352 00000100:00100000:1.0:1787583056.846919:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435827712 00000100:00100000:1.0:1787583056.846922:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435827712 00000100:00100000:1.0:1787583056.846939:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435828224 00000100:00100000:1.0:1787583056.846942:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435828224 00000100:00100000:1.0:1787583056.846959:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787583056.846968:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435827840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847020:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435827840:12345-0@lo:400:kworker.0 Request processed in 53us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.847028:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787583056.847045:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787583056.847051:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435828352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847080:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435828352:12345-0@lo:400:kworker.0 Request processed in 29us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.847086:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787583056.847097:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787583056.847104:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435827712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847133:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435827712:12345-0@lo:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.847149:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787583056.847162:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787583056.847168:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435828224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847198:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435828224:12345-0@lo:400:kworker.0 Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.847204:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787583056.847223:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435826944 00000100:00100000:1.0:1787583056.847227:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435826944 00000100:00100000:1.0:1787583056.847242:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435827456 00000100:00100000:1.0:1787583056.847244:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435827456 00000100:00100000:1.0:1787583056.847253:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435827968 00000100:00100000:1.0:1787583056.847255:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435827968 00000100:00100000:1.0:1787583056.847266:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435827200 00000100:00100000:1.0:1787583056.847269:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435827200 00000100:00100000:1.0:1787583056.847277:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435827584 00000100:00100000:1.0:1787583056.847279:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435827584 00000100:00100000:1.0:1787583056.847289:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435828096 00000100:00100000:1.0:1787583056.847291:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435828096 00000100:00100000:1.0:1787583056.847302:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787583056.847308:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435826944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847338:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435826944:12345-0@lo:400:kworker.0 Request processed in 31us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.847344:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787583056.847354:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787583056.847360:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435827456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847384:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435827456:12345-0@lo:400:kworker.0 Request processed in 25us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.847389:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787583056.847408:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787583056.847414:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435827968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847444:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435827968:12345-0@lo:400:kworker.0 Request processed in 30us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.847449:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787583056.847459:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787583056.847465:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435827200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847489:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435827200:12345-0@lo:400:kworker.0 Request processed in 25us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.847494:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787583056.847504:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787583056.847510:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435827584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847536:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435827584:12345-0@lo:400:kworker.0 Request processed in 26us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.847542:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787583056.847552:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787583056.847557:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435828096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847579:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435828096:12345-0@lo:400:kworker.0 Request processed in 22us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.847585:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787583056.847619:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435827328 00000100:00100000:1.0:1787583056.847623:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435827328 00000100:00100000:1.0:1787583056.847643:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435827072 00000100:00100000:1.0:1787583056.847646:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435827072 00000100:00100000:1.0:1787583056.847657:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787583056.847662:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435827328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847702:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435827328:12345-0@lo:400:kworker.0 Request processed in 39us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.847708:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787583056.847721:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787583056.847727:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435827072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847752:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435827072:12345-0@lo:400:kworker.0 Request processed in 26us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583056.847758:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1787583056.847774:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787583056.847778:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787583056.847781:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787583056.847810:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435827072:0@lo:400:kworker.0 00010000:00080000:1.0:1787583056.847824:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15f800 x1874416435827584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583056.847870:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435827584:0@lo:400:kworker.0 00010000:00080000:1.0:1787583056.847882:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245897800 x1874416435828096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583056.847890:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435828096:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847900:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435827200:0@lo:400:kworker.0 00010000:00080000:1.0:1787583056.847908:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15e680 x1874416435827712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583056.847915:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435827712:0@lo:400:kworker.0 00010000:00080000:1.0:1787583056.847923:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245895c00 x1874416435828224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583056.847937:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435828224:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847977:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435826944:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847987:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435827456:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.847995:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435827968:0@lo:400:kworker.0 00000100:00100000:1.0:1787583056.848005:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435827328:0@lo:400:kworker.0 00010000:00080000:1.0:1787583056.848014:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245897b80 x1874416435827840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583056.848021:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435827840:0@lo:400:kworker.0 00010000:00080000:1.0:1787583056.848030:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245897100 x1874416435828352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583056.848036:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435828352:0@lo:400:kworker.0 00000100:00100000:3.0:1787583056.848745:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435828480:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583056.848796:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583056.848968:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435828480 00000100:00100000:2.0:1787583056.848975:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435828480 00000100:00100000:2.0:1787583056.849017:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787583056.849026:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435828480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787583056.849067:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787583056.849114:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435828480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583056.849120:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787583056.849373:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435828480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583056.854263:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435828608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787583056.854348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583056.854455:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435828608 00000100:00100000:2.0:1787583056.854464:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435828608 00000100:00100000:2.0:1787583056.854521:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787583056.854531:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435828608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787583056.854559:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583056.868892:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435828608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14352us (14533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583056.868908:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1787583056.869023:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc89180 x1874416435828608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583056.869051:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435828608:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787583057.294476:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583057.360477:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583057.360500:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435828736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787583057.360564:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583057.360665:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435828736 00000100:00100000:2.0:1787583057.360672:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435828736 00000100:00100000:2.0:1787583057.360720:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787583057.360728:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435828736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583057.360748:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583057.360790:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435828736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583057.360796:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1787583057.360842:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245894380 x1874416435828736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583057.360884:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435828736:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787583058.319294:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583059.343406:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787583059.365950:0:13394:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787583059.742760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583059.742801:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583059.742838:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583059.742886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583059.742928:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583059.742954:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413724160 00000100:00100000:1.0:1787583059.742962:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413724160 00000100:00100000:1.0:1787583059.743008:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413724416 00000100:00100000:1.0:1787583059.743011:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413724416 00000100:00100000:1.0:1787583059.743025:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413724032 00000100:00100000:1.0:1787583059.743028:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413724032 00000100:00100000:1.0:1787583059.743042:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413724288 00000100:00100000:1.0:1787583059.743044:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413724288 00000100:00100000:1.0:1787583059.743059:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:1.0:1787583059.743069:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413724160:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583059.743156:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413724160:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 88us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583059.743164:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:1.0:1787583059.743180:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:1.0:1787583059.743187:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413724416:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583059.743211:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413724416:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583059.743217:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:1.0:1787583059.743228:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:1.0:1787583059.743235:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413724032:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583059.743257:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413724032:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583059.743263:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:1.0:1787583059.743462:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:1.0:1787583059.743474:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413724288:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583059.743506:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413724288:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583059.743513:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00080000:1.0:1787583059.743541:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787583059.743545:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787583059.752015:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413723904 00000100:00100000:2.0:1787583059.752042:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413723904 00000100:00100000:2.0:1787583059.752162:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 332 00000100:00100000:2.0:1787583059.752173:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2407:x1874416413723904:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583059.752256:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2407:x1874416413723904:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 85us (9506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583059.752264:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 332 00000100:00100000:0.0:1787583059.918598:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787583059.918622:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435828864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787583059.918697:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583059.918830:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435828864 00000100:00100000:1.0:1787583059.918839:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435828864 00000100:00100000:1.0:1787583059.918916:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787583059.918925:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435828864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787583059.918969:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787583059.919016:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435828864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583059.919024:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787583059.919066:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435828864:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787583060.366102:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583060.942041:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435828992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787583060.942122:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583060.942454:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435828992 00000100:00100000:0.0:1787583060.942462:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435828992 00000100:00100000:0.0:1787583060.942519:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787583060.942531:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435828992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583060.942561:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787583060.942653:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787583060.946164:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583060.946186:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435829120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787583060.946266:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583060.946323:0:8446:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787583060.946332:0:8446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787583060.946461:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435829120 00000100:00100000:2.0:1787583060.946468:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435829120 00000100:00080000:2.0:1787583060.946511:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787583060.946575:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787583060.946584:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435829120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583060.946603:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583060.946641:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435829120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583060.946647:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1787583060.946682:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245897480 x1874416435829120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583060.946702:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435829120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787583060.949009:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435828992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6472us (6878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583060.949032:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1787583060.949223:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092476e0700 x1874416435828992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583060.949246:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435828992:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787583061.393960:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583061.967892:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435829632:0@lo:400:kworker.0 00000100:00100000:0.0:1787583061.967979:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583061.968057:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435830144:0@lo:400:kworker.0 00000100:00100000:0.0:1787583061.968087:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583061.968108:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435830656:0@lo:400:kworker.0 00000100:00100000:0.0:1787583061.968129:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583061.968159:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787583061.968166:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435829248:0@lo:400:kworker.0 00000100:00100000:0.0:1787583061.968195:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583061.968222:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435829760:0@lo:400:kworker.0 00000100:00100000:0.0:1787583061.968245:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583061.968262:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435830272:0@lo:400:kworker.0 00000100:00100000:0.0:1787583061.968280:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583061.968293:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435830784:0@lo:400:kworker.0 00000100:00100000:0.0:1787583061.968311:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583061.968341:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435829248 00000100:00100000:0.0:1787583061.968348:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435829248 00000100:00100000:0.0:1787583061.968392:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787583061.968401:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435829248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583061.968450:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435829248:12345-0@lo:400:kworker.0 Request processed in 50us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583061.968456:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787583061.968513:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435829248:0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.968826:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435829376:0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.968881:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583061.968904:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435829888:0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.968925:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583061.968941:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435830400:0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.968960:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583061.968981:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787583061.968986:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435829504:0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.969006:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583061.969023:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435830016:0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.969041:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583061.969050:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435830528:0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.969066:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583061.969088:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435829632 00000100:00100000:2.0:1787583061.969092:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435829632 00000100:00100000:2.0:1787583061.969115:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435829376 00000100:00100000:2.0:1787583061.969118:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435829376 00000100:00100000:2.0:1787583061.969128:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435829888 00000100:00100000:2.0:1787583061.969130:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435829888 00000100:00100000:2.0:1787583061.969150:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435830400 00000100:00100000:2.0:1787583061.969153:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435830400 00000100:00100000:2.0:1787583061.969165:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435830016 00000100:00100000:2.0:1787583061.969167:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435830016 00000100:00100000:2.0:1787583061.969189:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435830528 00000100:00100000:2.0:1787583061.969192:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435830528 00000100:00100000:2.0:1787583061.969205:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787583061.969212:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435829632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.969253:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435829632:12345-0@lo:400:kworker.0 Request processed in 41us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583061.969260:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787583061.969275:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787583061.969281:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435829376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.969313:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435829376:12345-0@lo:400:kworker.0 Request processed in 32us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583061.969318:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787583061.969329:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787583061.969334:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435829888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.969359:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435829888:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583061.969365:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787583061.969375:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787583061.969381:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435830400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.969406:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435830400:12345-0@lo:400:kworker.0 Request processed in 25us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583061.969411:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787583061.969422:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787583061.969428:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435830016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.969452:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435830016:12345-0@lo:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583061.969465:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787583061.969476:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787583061.969481:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435830528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.969508:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435830528:12345-0@lo:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583061.969512:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787583061.969538:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435829760 00000100:00100000:2.0:1787583061.969542:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435829760 00000100:00100000:2.0:1787583061.969560:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435829504 00000100:00100000:2.0:1787583061.969562:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435829504 00000100:00100000:2.0:1787583061.969572:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787583061.969577:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435829760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.969608:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435829760:12345-0@lo:400:kworker.0 Request processed in 31us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583061.969614:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787583061.969625:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787583061.969630:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435829504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.969656:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435829504:12345-0@lo:400:kworker.0 Request processed in 26us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583061.969662:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1787583061.969677:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583061.969680:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583061.969703:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435829504:0@lo:400:kworker.0 00000100:00100000:0.0:1787583061.973330:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435829760:0@lo:400:kworker.0 00000100:00100000:0.0:1787583061.973350:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435829632:0@lo:400:kworker.0 00010000:00080000:2.0:1787583061.973463:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b61180 x1874416435830016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583061.973478:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435830016:0@lo:400:kworker.0 00010000:00080000:2.0:1787583061.973515:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f14d880 x1874416435830528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583061.973525:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435830528:0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.973538:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435829376:0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.973550:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435829888:0@lo:400:kworker.0 00000100:00100000:2.0:1787583061.973562:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435830400:0@lo:400:kworker.0 00000100:00100000:1.0:1787583061.973669:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435830144 00000100:00100000:1.0:1787583061.973676:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435830144 00000100:00100000:1.0:1787583061.973723:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435830656 00000100:00100000:1.0:1787583061.973733:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435830656 00000100:00100000:1.0:1787583061.973764:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435830272 00000100:00100000:1.0:1787583061.973766:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435830272 00000100:00100000:1.0:1787583061.973776:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435830784 00000100:00100000:1.0:1787583061.973778:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435830784 00000100:00100000:1.0:1787583061.973792:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787583061.973811:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435830144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583061.973921:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435830144:12345-0@lo:400:kworker.0 Request processed in 111us (5832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583061.973928:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787583061.973953:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787583061.973959:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435830656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583061.973992:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435830656:12345-0@lo:400:kworker.0 Request processed in 33us (5862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583061.973998:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787583061.974008:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787583061.974014:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435830272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583061.974040:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435830272:12345-0@lo:400:kworker.0 Request processed in 27us (5759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583061.974046:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787583061.974056:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787583061.974062:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435830784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583061.974092:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435830784:12345-0@lo:400:kworker.0 Request processed in 31us (5780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583061.974098:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1787583061.974289:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f14d500 x1874416435830272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583061.974300:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435830272:0@lo:400:kworker.0 00010000:00080000:0.0:1787583061.974309:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f14c380 x1874416435830784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583061.974317:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435830784:0@lo:400:kworker.0 00010000:00080000:0.0:1787583061.974326:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b63800 x1874416435830144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583061.974334:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435830144:0@lo:400:kworker.0 00010000:00080000:0.0:1787583061.974343:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f14d180 x1874416435830656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583061.974350:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435830656:0@lo:400:kworker.0 00000100:00080000:2.0:1787583061.974416:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583061.974633:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435830912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787583061.974672:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583061.974954:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435830912 00000100:00100000:3.0:1787583061.974961:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435830912 00000100:00100000:3.0:1787583061.975005:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787583061.975013:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435830912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787583061.975036:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583061.975088:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435830912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583061.975094:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1787583061.975157:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc88e00 x1874416435830912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583061.975173:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435830912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787583061.975436:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787583061.975446:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435831040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787583061.975478:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583061.975584:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435831040 00000100:00100000:2.0:1787583061.975589:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435831040 00000100:00100000:2.0:1787583061.975625:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787583061.975632:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435831040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787583061.975654:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787583061.975701:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435831040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583061.975708:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787583061.975935:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435831040:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787583062.419088:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583062.485010:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435831168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583062.485329:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583062.485461:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435831168 00000100:00100000:1.0:1787583062.485470:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435831168 00000100:00100000:1.0:1787583062.485528:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787583062.485539:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435831168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787583062.485560:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583062.485619:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435831168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583062.485641:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1787583062.485682:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f2b6300 x1874416435831168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583062.485702:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435831168:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787583063.439187:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583064.461952:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787583064.839893:0:13544:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:51:02 (1787583062) === 00000100:00100000:1.0:1787583064.858357:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583064.858396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583064.858421:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583064.858443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583064.858468:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583064.858496:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413724800 00000100:00100000:1.0:1787583064.858506:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413724800 00000100:00100000:1.0:1787583064.858560:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413725056 00000100:00100000:1.0:1787583064.858563:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413725056 00000100:00100000:1.0:1787583064.858577:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413724672 00000100:00100000:1.0:1787583064.858580:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413724672 00000100:00100000:1.0:1787583064.858592:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413724928 00000100:00100000:1.0:1787583064.858594:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413724928 00000100:00100000:1.0:1787583064.858610:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:1.0:1787583064.858621:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413724800:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583064.858693:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413724800:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583064.858701:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:1.0:1787583064.858716:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 201 00000100:00100000:1.0:1787583064.858722:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413725056:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583064.858748:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413725056:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583064.858772:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 201 00000100:00100000:1.0:1787583064.858799:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:1.0:1787583064.858807:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413724672:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583064.858834:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413724672:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583064.858840:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:1.0:1787583064.858871:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:1.0:1787583064.858877:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413724928:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583064.858901:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413724928:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583064.858907:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00080000:1.0:1787583064.858933:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787583064.858936:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787583064.860362:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413724544 00000100:00100000:0.0:1787583064.860387:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413724544 00000100:00100000:0.0:1787583064.860442:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 334 00000100:00100000:0.0:1787583064.860451:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413724544:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583064.860507:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413724544:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 57us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583064.860514:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 334 00000100:00100000:1.0:1787583065.038220:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787583065.038245:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f14d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435831296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583065.038325:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583065.038509:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435831296 00000100:00100000:3.0:1787583065.038516:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435831296 00000100:00100000:3.0:1787583065.038558:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787583065.038568:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435831296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787583065.038601:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787583065.038663:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435831296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583065.038670:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787583065.038713:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f14d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435831296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583065.096858:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583065.097005:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413725312 00000100:00100000:2.0:1787583065.097016:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413725312 00000100:00100000:2.0:1787583065.097066:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:2.0:1787583065.097078:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:10508:x1874416413725312:12345-192.168.203.11@tcp:700:mkdir.0 00000100:00100000:2.0:1787583065.097431:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:10508:x1874416413725312:12345-192.168.203.11@tcp:700:mkdir.0 Request processed in 353us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583065.097448:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1787583065.097568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583065.098017:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413725184 00000100:00100000:2.0:1787583065.098024:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413725184 00000100:00100000:2.0:1787583065.098102:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:2.0:1787583065.098112:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413725184:12345-192.168.203.11@tcp:41:mkdir.0 00000004:00000024:2.0:1787583065.098133:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787583065.098204:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413725184:12345-192.168.203.11@tcp:41:mkdir.0 Request processed in 95us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583065.098211:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1787583065.107197:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583065.107352:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413725568 00000100:00100000:1.0:1787583065.107362:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413725568 00000100:00100000:1.0:1787583065.107427:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:1.0:1787583065.107439:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:10508:x1874416413725568:12345-192.168.203.11@tcp:36:mkdir.0 00010000:00010000:1.0:1787583065.107494:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583065.107563:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b618a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c408f expref: 6 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.107584:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff909345181f00) 00010000:00010000:1.0:1787583065.107608:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583065.107697:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b62e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.107709:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b62e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.107718:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b62e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.107730:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b62ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.107737:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b62ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.107743:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b62ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108341:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b62f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108352:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b62f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108359:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b62f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583065.108374:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000472cdc05 reply state 00000000ae51229d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b62f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108385:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b62f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108403:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90935a4d4300) 00010000:00010000:1.0:1787583065.108406:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787583065.108409:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787583065.108415:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787583065.108422:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b62e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108428:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b62e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108435:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b62e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108441:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583065.108445:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b62e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108452:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b62e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108461:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90935a4d4b00) 00010000:00010000:1.0:1787583065.108463:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583065.108466:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b62e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108471:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b62e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583065.108483:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000472cdc05 reply state 00000000ae51229d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b62ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108501:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b62ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.108505:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90935a4d4e00) 00010000:00010000:1.0:1787583065.108507:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787583065.108509:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787583065.108592:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:10508:x1874416413725568:12345-192.168.203.11@tcp:36:mkdir.0 Request processed in 1154us (1404us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787583065.108600:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:3.0:1787583065.124497:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583065.125570:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413725696 00000100:00100000:0.0:1787583065.125584:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413725696 00000100:00100000:0.0:1787583065.125653:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:0.0:1787583065.125665:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:10511:x1874416413725696:12345-192.168.203.11@tcp:101:chmod.0 00010000:00010000:0.0:1787583065.125687:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583065.125711:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b62fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4122 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.125785:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6304 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.125798:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.125809:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583065.125896:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787583065.125900:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583065.125936:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.125963:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b62fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4122 expref: 9 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.126001:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6304 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4122 expref: 8 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.126010:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9093736c3800) 00010000:00010000:0.0:1787583065.126013:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583065.126016:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e000, rc 0) 00000100:00100000:0.0:1787583065.126092:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:10511:x1874416413725696:12345-192.168.203.11@tcp:101:chmod.0 Request processed in 428us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583065.129218:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:3.0:1787583065.141687:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583065.141897:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413725952 00000100:00100000:2.0:1787583065.141909:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413725952 00000100:00100000:2.0:1787583065.141974:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1787583065.141985:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:10511:x1874416413725952:12345-192.168.203.11@tcp:36:chmod.0 00010000:00010000:2.0:1787583065.142040:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583065.142066:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6304 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4122 expref: 8 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.142087:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9093736c3800) 00010000:00010000:2.0:1787583065.142096:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583065.142121:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b630b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.142134:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b630b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.142259:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b630b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787583065.142485:0:6529:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d094435c reply state 000000001443dd6e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b630b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.142498:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b630b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.142505:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9093516fb500) 00010000:00010000:2.0:1787583065.142507:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787583065.142510:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787583065.142518:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787583065.142695:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:10511:x1874416413725952:12345-192.168.203.11@tcp:36:chmod.0 Request processed in 710us (1015us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787583065.142702:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1787583065.180986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583065.181108:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413726080 00000100:00100000:2.0:1787583065.181118:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413726080 00000100:00100000:2.0:1787583065.181177:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:2.0:1787583065.181186:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:10514:x1874416413726080:12345-192.168.203.11@tcp:101:chown.0 00010000:00010000:2.0:1787583065.181209:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583065.181229:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4129 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.181291:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b6319 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.181303:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b6319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.181315:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b6319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583065.181394:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787583065.181398:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583065.181449:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b6319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.181475:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4129 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.181493:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b6319 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4129 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.181502:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9093516fb500) 00010000:00010000:2.0:1787583065.181505:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787583065.181508:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770b000, rc 0) 00000100:00100000:2.0:1787583065.181578:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:10514:x1874416413726080:12345-192.168.203.11@tcp:101:chown.0 Request processed in 393us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583065.181585:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:2.0:1787583065.185414:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583065.185699:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413726208 00000100:00100000:1.0:1787583065.185710:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413726208 00000100:00100000:1.0:1787583065.185786:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1787583065.185798:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:10514:x1874416413726208:12345-192.168.203.11@tcp:101:chown.0 00010000:00010000:1.0:1787583065.185821:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583065.185840:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6320 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4130 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.185928:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6327 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.185941:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6327 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.185950:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6327 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.185961:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b632e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.185990:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b632e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.185996:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b632e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186073:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6335 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186082:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186090:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583065.186135:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787583065.186139:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787583065.186171:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186452:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6327 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186460:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6327 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186466:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6327 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186472:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583065.186476:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6327 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186491:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6327 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186503:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9093516fb500) 00010000:00010000:1.0:1787583065.186506:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583065.186510:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6327 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186515:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6327 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186528:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b632e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186534:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b632e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186540:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b632e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186545:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583065.186548:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b632e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186554:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b632e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186561:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90935a4d4e00) 00010000:00010000:1.0:1787583065.186563:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583065.186566:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b632e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186582:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b632e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186627:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6320 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4130 expref: 12 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186701:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4130 expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.186709:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90935a4d4300) 00010000:00010000:1.0:1787583065.186711:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787583065.186714:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52200, rc 0) 00000100:00100000:1.0:1787583065.186929:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:10514:x1874416413726208:12345-192.168.203.11@tcp:101:chown.0 Request processed in 1132us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583065.186937:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:3.0:1787583065.195570:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583065.199744:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413726336 00000100:00100000:0.0:1787583065.199760:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413726336 00000100:00100000:0.0:1787583065.199972:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:0.0:1787583065.199984:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:10514:x1874416413726336:12345-192.168.203.11@tcp:900:chown.0 00000100:00100000:0.0:1787583065.200082:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:10514:x1874416413726336:12345-192.168.203.11@tcp:900:chown.0 Request processed in 100us (4520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583065.200091:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1787583065.210398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583065.210500:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413726592 00000100:00100000:2.0:1787583065.210509:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413726592 00000100:00100000:2.0:1787583065.210567:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:2.0:1787583065.210578:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:10514:x1874416413726592:12345-192.168.203.11@tcp:36:chown.0 00010000:00010000:2.0:1787583065.210637:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583065.210673:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6335 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4130 expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.210692:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90935a4d4300) 00010000:00010000:2.0:1787583065.210712:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583065.210732:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b633c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.210744:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b633c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.210753:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b633c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787583065.214004:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1787583065.214270:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014fe088f reply state 0000000014aece18 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b633c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.214290:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b633c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.214299:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90935a4d4300) 00010000:00010000:2.0:1787583065.214302:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787583065.214306:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787583065.214319:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1787583065.214422:0:6528:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787583065.214445:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:10514:x1874416413726592:12345-192.168.203.11@tcp:36:chown.0 Request processed in 3866us (4053us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787583065.214453:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00010000:00010000:0.0:1787583065.215516:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b633c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.215531:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b633c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.215538:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b633c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.215545:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770ae00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583065.215549:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b633c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.215572:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b633c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.215586:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90935a4d4300) 00010000:00010000:0.0:1787583065.215589:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787583065.215594:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b633c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.215602:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b633c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.218942:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b62ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.218961:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b62ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.218970:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b62ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.218976:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583065.218980:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b62ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219060:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b62ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219455:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90935a4d4e00) 00010000:00010000:1.0:1787583065.219460:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583065.219466:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b62ef lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219473:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b62ef lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219496:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b62f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219503:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b62f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219509:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b62f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219514:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52a00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583065.219517:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b62f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219523:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b62f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219530:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90935a4d4300) 00010000:00010000:1.0:1787583065.219533:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583065.219536:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b62f6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219542:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b62f6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219568:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b630b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219574:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b630b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219579:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b630b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219584:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583065.219588:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b630b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219963:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b630b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219973:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9093516fb500) 00010000:00010000:1.0:1787583065.219976:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787583065.219979:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b630b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.219984:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b630b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583065.247098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583065.247511:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413726720 00000100:00100000:3.0:1787583065.247522:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413726720 00000100:00100000:3.0:1787583065.247593:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:3.0:1787583065.247604:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:10515:x1874416413726720:12345-192.168.203.11@tcp:101:touch.500 00010000:00010000:3.0:1787583065.247626:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583065.247649:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4137 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787583065.256336:0:6529:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 8640us 00010000:00010000:0.0:1787583065.298752:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b634a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.298788:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b634a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.298802:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b634a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.298819:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6351 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.298827:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.298834:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299138:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b6358 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299162:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b6358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299170:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b6358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583065.299207:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787583065.299211:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583065.299260:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b6358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299272:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b634a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299279:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b634a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299286:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b634a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299292:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583065.299296:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b634a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299302:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b634a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299314:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9093516fb500) 00010000:00010000:0.0:1787583065.299317:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583065.299322:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b634a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299338:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b634a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299351:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299358:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6351 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299364:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6351 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299369:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583065.299372:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6351 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299378:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6351 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299385:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9093736c3100) 00010000:00010000:0.0:1787583065.299388:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583065.299390:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6351 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299712:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6351 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299756:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4137 expref: 8 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299781:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b6358 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4137 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.299796:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9093736c3f00) 00010000:00010000:0.0:1787583065.299798:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787583065.299801:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713ea00, rc 0) 00000100:00100000:0.0:1787583065.300297:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:10515:x1874416413726720:12345-192.168.203.11@tcp:101:touch.500 Request processed in 52691us (53206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583065.300307:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:3.0:1787583065.317083:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583065.317184:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413726976 00000100:00100000:1.0:1787583065.317195:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413726976 00000100:00100000:1.0:1787583065.317357:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1787583065.317369:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:10515:x1874416413726976:12345-192.168.203.11@tcp:101:touch.500 00010000:00010000:1.0:1787583065.317388:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583065.317409:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b635f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c413e expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.317531:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6366 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.317545:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6366 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.317555:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6366 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.317568:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b636d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.317574:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b636d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.317580:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b636d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787583065.318711:0:7748:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787583065.320672:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6374 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320695:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6374 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320706:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6374 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320748:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6366 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320782:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6366 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320790:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6366 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320796:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583065.320801:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6366 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320808:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6366 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320821:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9093736c3f00) 00010000:00010000:1.0:1787583065.320824:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583065.320828:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6366 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320834:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6366 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583065.320864:0:7748:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ae8da02 reply state 00000000e8201988 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b636d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320876:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b636d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320883:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d0a4730 (ffff90935a4d4300) 00010000:00010000:1.0:1787583065.320885:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787583065.320889:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787583065.320930:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b635f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c413e expref: 10 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320951:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6374 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c413e expref: 9 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.320959:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90935a4d4e00) 00010000:00010000:1.0:1787583065.320961:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787583065.320963:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52000, rc 0) 00000100:00100000:1.0:1787583065.321325:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:10515:x1874416413726976:12345-192.168.203.11@tcp:101:touch.500 Request processed in 3956us (4249us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787583065.321334:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:0.0:1787583065.339526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583065.339641:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413727232 00000100:00100000:2.0:1787583065.339652:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413727232 00000100:00100000:2.0:1787583065.339721:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:2.0:1787583065.339733:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:10515:x1874416413727232:12345-192.168.203.11@tcp:36:touch.500 00010000:00010000:2.0:1787583065.339802:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583065.339830:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6374 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c413e expref: 10 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.339887:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90935a4d4e00) 00010000:00010000:2.0:1787583065.339898:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583065.339961:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6382 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.339974:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6382 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.339984:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6382 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787583065.340098:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f2c7a93 reply state 00000000ecc20a0f transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6382 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.340110:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6382 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.340115:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9093516fbf00) 00010000:00010000:2.0:1787583065.340118:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787583065.340120:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787583065.340886:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:10515:x1874416413727232:12345-192.168.203.11@tcp:36:touch.500 Request processed in 482us (698us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787583065.340897:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:2.0:1787583065.346955:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583065.347051:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413727360 00000100:00100000:1.0:1787583065.347062:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413727360 00000100:00100000:1.0:1787583065.347139:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:1.0:1787583065.347150:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:10515:x1874416413727360:12345-192.168.203.11@tcp:101:touch.500 00010000:00010000:1.0:1787583065.347173:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583065.347192:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6389 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4145 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.347249:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6389 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4145 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.347263:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6389 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4145 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.347282:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9093516fbf00) 00010000:00010000:1.0:1787583065.347285:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787583065.347305:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52a00, rc 0) 00000100:00100000:1.0:1787583065.347369:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+12:10515:x1874416413727360:12345-192.168.203.11@tcp:101:touch.500 Request processed in 220us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583065.347376:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:3.0:1787583065.352948:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583065.353258:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413727488 00000100:00100000:1.0:1787583065.353268:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413727488 00000100:00100000:1.0:1787583065.353318:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:1.0:1787583065.353327:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1874416413727488:12345-192.168.203.11@tcp:8:touch.500 00010000:00080000:1.0:1787583065.353366:0:8442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp t0 exp 0000000000000000 cur 372 last 0 00000020:00000080:1.0:1787583065.353397:0:8442:0:(genops.c:1385:class_connect()) connect: client c54c7da2-d1ec-4db9-98d7-e170a1f2cfae, cookie 0x19a47956376b6390 00002000:00100000:1.0:1787583065.353408:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c54c7da2-d1ec-4db9-98d7-e170a1f2cfae/ffff90937fc03800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787583065.353426:0:8442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787583065.353509:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787583065.353539:0:8442:0:(import.c:65:import_set_state_nolock()) ffff90937fc06800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787583065.353609:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2403:x1874416413727488:12345-192.168.203.11@tcp:8:touch.500 Request processed in 281us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583065.353617:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1787583065.371592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583065.371687:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413727616 00000100:00100000:1.0:1787583065.371697:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413727616 00000100:00100000:1.0:1787583065.371787:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:1.0:1787583065.371799:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937e5a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:0:x1874416413727616:12345-192.168.203.11@tcp:2:touch.500 00000100:00080000:2.0:1787583065.372341:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787583065.373568:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1787583065.373578:0:8437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000100:00100000:1.0:1787583065.374410:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937e5a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:0:x1874416413727616:12345-192.168.203.11@tcp:2:touch.500 Request processed in 2607us (2821us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787583065.374421:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1787583065.376885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583065.376991:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413727872 00000100:00100000:2.0:1787583065.377001:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413727872 00000100:00100000:2.0:1787583065.377051:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:2.0:1787583065.377087:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+12:10515:x1874416413727872:12345-192.168.203.11@tcp:35:touch.500 00000100:00100000:2.0:1787583065.377369:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+13:10515:x1874416413727872:12345-192.168.203.11@tcp:35:touch.500 Request processed in 284us (528us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787583065.377377:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:1.0:1787583065.394290:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583065.394494:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413728000 00000100:00100000:0.0:1787583065.394505:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413728000 00000100:00100000:0.0:1787583065.394567:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1787583065.394579:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+13:10516:x1874416413728000:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1787583065.394612:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583065.394641:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b6397 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c414c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.394706:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b639e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.394719:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b639e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.394730:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b639e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583065.394786:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787583065.394804:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583065.394887:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b639e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.394914:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b6397 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c414c expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.394930:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b639e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c414c expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.394939:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9093736c3f00) 00010000:00010000:0.0:1787583065.394941:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583065.394945:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fc00, rc 0) 00000100:00100000:0.0:1787583065.395005:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:10516:x1874416413728000:12345-192.168.203.11@tcp:101:rm.0 Request processed in 428us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583065.395011:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1787583065.402553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583065.403345:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413728256 00000100:00100000:1.0:1787583065.403373:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413728256 00000100:00100000:1.0:1787583065.403436:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1787583065.403448:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:10516:x1874416413728256:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1787583065.403468:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583065.403489:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b63a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4153 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583065.403594:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787583065.403750:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b63a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4153 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.403765:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9093516fb500) 00010000:00010000:1.0:1787583065.403768:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787583065.403782:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b63a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4153 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.403794:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53800, rc 0) 00000100:00100000:1.0:1787583065.403898:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:10516:x1874416413728256:12345-192.168.203.11@tcp:101:rm.0 Request processed in 452us (1354us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1787583065.403906:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:3.0:1787583065.417591:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583065.417678:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413728384 00000100:00100000:0.0:1787583065.417687:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413728384 00000100:00100000:0.0:1787583065.417741:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:0.0:1787583065.417752:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:10516:x1874416413728384:12345-192.168.203.11@tcp:37:rm.0 00000100:00100000:0.0:1787583065.422076:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:10516:x1874416413728384:12345-192.168.203.11@tcp:37:rm.0 Request processed in 4316us (4484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583065.422089:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1787583065.428382:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583065.428520:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413728640 00000100:00100000:2.0:1787583065.428530:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413728640 00000100:00100000:2.0:1787583065.428596:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1787583065.428608:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373fa5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:10516:x1874416413728640:12345-192.168.203.11@tcp:35:rm.0 00000100:00100000:2.0:1787583065.428884:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373fa5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:10516:x1874416413728640:12345-192.168.203.11@tcp:35:rm.0 Request processed in 277us (509us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787583065.428893:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1787583065.438746:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583065.438877:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413728896 00000100:00100000:0.0:1787583065.438886:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413728896 00000100:00100000:0.0:1787583065.438949:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:0.0:1787583065.438959:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:10516:x1874416413728896:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1787583065.439000:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583065.439020:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b63b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c415a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.439380:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b63ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.439395:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b63ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.439407:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b63ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583065.439419:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787583065.439535:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b63b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c415a expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.439553:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b63ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c415a expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583065.439561:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9093736c3f00) 00010000:00010000:0.0:1787583065.439564:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787583065.439566:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f600, rc 0) 00000100:00100000:0.0:1787583065.439629:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:10516:x1874416413728896:12345-192.168.203.11@tcp:101:rm.0 Request processed in 672us (893us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787583065.439637:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:3.0:1787583065.442707:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583065.442814:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413729024 00000100:00100000:1.0:1787583065.442823:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413729024 00000100:00100000:1.0:1787583065.442899:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:1.0:1787583065.442908:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:10516:x1874416413729024:12345-192.168.203.11@tcp:41:rm.0 00000004:00000024:1.0:1787583065.442961:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1787583065.443030:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:10516:x1874416413729024:12345-192.168.203.11@tcp:41:rm.0 Request processed in 121us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583065.443054:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:1.0:1787583065.453262:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583065.453337:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413729152 00000100:00100000:2.0:1787583065.453347:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413729152 00000100:00100000:2.0:1787583065.453406:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:2.0:1787583065.453416:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:10516:x1874416413729152:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1787583065.453437:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583065.453455:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b63c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4161 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453520:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b400/0x19a47956376b63cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453533:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b400/0x19a47956376b63cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453543:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b400/0x19a47956376b63cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453576:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b63d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453584:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b63d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453591:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b63d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453714:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b63dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453723:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b63dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453730:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b63dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583065.453768:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787583065.453780:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583065.453798:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b63dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453810:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b63dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453817:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b400/0x19a47956376b63cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453823:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b400/0x19a47956376b63cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453838:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b400/0x19a47956376b63cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453882:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583065.453886:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b400/0x19a47956376b63cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453894:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b400/0x19a47956376b63cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453906:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9093736c3f00) 00010000:00010000:2.0:1787583065.453910:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583065.453914:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b400/0x19a47956376b63cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453919:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b400/0x19a47956376b63cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453931:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b63d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453937:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b63d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453942:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b63d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453947:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770bc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583065.453950:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b63d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453966:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b63d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.453975:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d0a4730 (ffff90935a4d4300) 00010000:00010000:2.0:1787583065.453977:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583065.453980:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b63d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.454225:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b63d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.454257:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b63c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4161 expref: 20 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.454271:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b63dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4161 expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.454278:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9093516fbf00) 00010000:00010000:2.0:1787583065.454280:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583065.454283:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770b200, rc 0) 00000100:00100000:2.0:1787583065.454349:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:10516:x1874416413729152:12345-192.168.203.11@tcp:101:rm.0 Request processed in 933us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583065.454356:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:3.0:1787583065.456948:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583065.457094:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413729408 00000100:00100000:1.0:1787583065.457103:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413729408 00000100:00100000:1.0:1787583065.457171:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:1.0:1787583065.457184:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:10516:x1874416413729408:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1787583065.457233:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787583065.457258:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b63dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4161 expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457281:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6389 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4145 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457291:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9093516fbf00) 00010000:00010000:1.0:1787583065.457299:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b639e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c414c expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457306:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9093736c3f00) 00010000:00010000:1.0:1787583065.457309:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583065.457328:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b63e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457340:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b63e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457349:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b63e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457382:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b63eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457389:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b63eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457396:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b63eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457511:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b63f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457521:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b63f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457528:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b63f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787583065.457755:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787583065.457765:0:6528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372610919044ns, next at 373610917299ns, rc = 0 00010000:00010000:1.0:1787583065.457821:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b63f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457830:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b63f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457838:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b63f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457885:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b63f9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457904:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b63f9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457910:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b63f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457926:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787583065.457944:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b63f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457951:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b63f2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457957:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b63f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457962:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52c00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583065.457966:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b63f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457973:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b63f2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.457983:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9093516fbf00) 00010000:00010000:1.0:1787583065.457995:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787583065.458000:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b63f2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.458007:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b63f2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.458021:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b63e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.458034:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b63e4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.458040:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b63e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.458045:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583065.458049:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b63e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.458054:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b63e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.458062:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9093736c3f00) 00010000:00010000:1.0:1787583065.458065:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583065.458067:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b63e4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.458073:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b63e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583065.458082:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031a4d217 reply state 0000000097ea0c3a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b63eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.458093:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b63eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583065.458099:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d0a4730 (ffff90935a4d4300) 00010000:00010000:1.0:1787583065.458102:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787583065.458104:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787583065.458177:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:10516:x1874416413729408:12345-192.168.203.11@tcp:36:rm.0 Request processed in 994us (1236us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787583065.458192:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00010000:00010000:3.0:1787583065.458836:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583065.458881:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b63f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583065.458889:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52400 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583065.458901:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b63f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583065.458908:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b63f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583065.458920:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9093516fbf00) 00010000:00010000:3.0:1787583065.458922:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787583065.458925:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b63f9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583065.458930:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b63f9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583065.458941:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583065.458943:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583065.458945:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583065.465852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583065.468037:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413729664 00000100:00100000:2.0:1787583065.468052:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413729664 00000100:00100000:2.0:1787583065.468115:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1787583065.468134:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:10516:x1874416413729664:12345-192.168.203.11@tcp:35:rm.0 00000100:00100000:2.0:1787583065.468387:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:10516:x1874416413729664:12345-192.168.203.11@tcp:35:rm.0 Request processed in 254us (2543us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787583065.468395:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1787583065.471223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583065.471286:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413729920 00000100:00100000:2.0:1787583065.471297:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413729920 00000100:00100000:2.0:1787583065.471356:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1787583065.471367:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:10516:x1874416413729920:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1787583065.471421:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787583065.471447:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b63ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c415a expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471466:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b6358 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4137 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471475:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9093736c3f00) 00010000:00010000:2.0:1787583065.471490:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b6319 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4129 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471499:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9093516fb500) 00010000:00010000:2.0:1787583065.471505:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583065.471528:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6400 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471540:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6400 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471549:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6400 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471577:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6407 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471584:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6407 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471590:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6407 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471676:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b640e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471684:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b640e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471690:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b640e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583065.471958:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787583065.471973:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b640e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471981:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b640e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471987:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b640e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.471992:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583065.471995:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b640e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.472013:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b640e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.472023:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9093516fbb00) 00010000:00010000:2.0:1787583065.472025:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787583065.472029:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b640e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.472035:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b200/0x19a47956376b640e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.472052:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6400 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.472058:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6400 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.472076:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6400 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.472081:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770ae00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583065.472084:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6400 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.472089:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6400 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.472097:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9093516fb700) 00010000:00010000:2.0:1787583065.472099:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583065.472103:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6400 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.472119:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6400 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787583065.472132:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000264cb078 reply state 00000000038b872b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6407 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.472143:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6407 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583065.472150:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9093516fb400) 00010000:00010000:2.0:1787583065.472152:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787583065.472155:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787583065.472229:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:10516:x1874416413729920:12345-192.168.203.11@tcp:36:rm.0 Request processed in 862us (1012us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787583065.472237:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00010000:00010000:2.0:1787583065.486308:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583066.063325:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435831424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583066.063529:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435831552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583066.063595:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583066.063678:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435831552 00000100:00100000:2.0:1787583066.063686:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435831552 00000100:00100000:1.0:1787583066.063732:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583066.063954:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435831424 00000100:00100000:2.0:1787583066.063958:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435831424 00000100:00100000:3.0:1787583066.064002:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787583066.064012:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435831552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787583066.064035:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583066.064178:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787583066.064189:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435831424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787583066.064203:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583066.064240:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435831424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583066.064247:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1787583066.064288:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245ae7100 x1874416435831424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583066.064311:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435831424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583066.064321:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435831552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 307us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583066.064340:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1787583066.064370:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245ae6680 x1874416435831552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583066.064384:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435831552:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787583066.064520:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787583066.513921:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583067.087242:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435831680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583067.087322:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583067.087395:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435831680 00000100:00100000:3.0:1787583067.087402:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435831680 00000100:00100000:3.0:1787583067.087452:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787583067.087475:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435831680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787583067.087503:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583067.087545:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435831680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583067.087553:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1787583067.087573:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787583067.087600:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909365f16d80 x1874416435831680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583067.087620:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435831680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583067.088420:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435831808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583067.088470:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583067.088591:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435831808 00000100:00100000:2.0:1787583067.088597:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435831808 00000100:00100000:2.0:1787583067.088635:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787583067.088643:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435831808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787583067.088668:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787583067.088721:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435831808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583067.088728:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787583067.090447:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435831808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787583067.090790:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435832064:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.090868:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583067.090921:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435832576:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.090947:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583067.090963:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435833088:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.090981:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583067.091002:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787583067.091007:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435831936:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091033:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583067.091052:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435832448:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091072:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583067.091100:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435832960:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091122:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583067.091145:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435832064 00000100:00100000:0.0:1787583067.091151:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435832064 00000100:00100000:0.0:1787583067.091182:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435832576 00000100:00100000:0.0:1787583067.091185:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435832576 00000100:00100000:0.0:1787583067.091204:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435833088 00000100:00100000:0.0:1787583067.091206:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435833088 00000100:00100000:0.0:1787583067.091218:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435832448 00000100:00100000:0.0:1787583067.091220:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435832448 00000100:00100000:0.0:1787583067.091232:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435832960 00000100:00100000:0.0:1787583067.091234:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435832960 00000100:00100000:0.0:1787583067.091250:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787583067.091257:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435832064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091303:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435832064:12345-0@lo:400:kworker.0 Request processed in 46us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583067.091311:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787583067.091327:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787583067.091334:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435832576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091368:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435832576:12345-0@lo:400:kworker.0 Request processed in 35us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583067.091375:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787583067.091387:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787583067.091393:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435833088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091417:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435833088:12345-0@lo:400:kworker.0 Request processed in 25us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583067.091423:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787583067.091432:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787583067.091437:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435832448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091470:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435832448:12345-0@lo:400:kworker.0 Request processed in 22us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583067.091477:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787583067.091489:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787583067.091495:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435832960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091519:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435832960:12345-0@lo:400:kworker.0 Request processed in 25us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583067.091525:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787583067.091550:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435832320:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091572:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583067.091588:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435832832:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091609:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583067.091625:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787583067.091631:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435832192:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091663:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583067.091680:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435832704:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091699:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583067.091714:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435833216:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091733:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583067.091754:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435832832 00000100:00100000:0.0:1787583067.091758:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435832832 00000100:00100000:0.0:1787583067.091791:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435832704 00000100:00100000:0.0:1787583067.091794:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435832704 00000100:00100000:0.0:1787583067.091804:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435833216 00000100:00100000:0.0:1787583067.091806:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435833216 00000100:00100000:0.0:1787583067.091820:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787583067.091826:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435832832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091882:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435832832:12345-0@lo:400:kworker.0 Request processed in 56us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583067.091889:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787583067.091900:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787583067.091907:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435832704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091932:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435832704:12345-0@lo:400:kworker.0 Request processed in 26us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583067.091939:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787583067.091949:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787583067.091955:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435833216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.091980:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435833216:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583067.091986:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787583067.092027:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435832448:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.092037:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435832960:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.092046:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435832064:0@lo:400:kworker.0 00010000:00080000:0.0:1787583067.092057:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15f800 x1874416435832576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583067.092067:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435832576:0@lo:400:kworker.0 00010000:00080000:0.0:1787583067.092076:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247da7480 x1874416435833088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583067.092084:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435833088:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.092107:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435832320 00000100:00100000:0.0:1787583067.092111:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435832320 00000100:00100000:0.0:1787583067.092134:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787583067.092139:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435832320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.092167:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435832320:12345-0@lo:400:kworker.0 Request processed in 28us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583067.092173:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00080000:0.0:1787583067.092197:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15c700 x1874416435832704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583067.092205:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435832704:0@lo:400:kworker.0 00010000:00080000:0.0:1787583067.092213:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247da4700 x1874416435833216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583067.092221:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435833216:0@lo:400:kworker.0 00000100:00100000:0.0:1787583067.092231:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435832320:0@lo:400:kworker.0 00010000:00080000:0.0:1787583067.092250:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15f480 x1874416435832832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583067.092259:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435832832:0@lo:400:kworker.0 00000100:00100000:1.0:1787583067.093919:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435831936 00000100:00100000:1.0:1787583067.093930:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435831936 00000100:00100000:1.0:1787583067.093978:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787583067.093986:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435831936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583067.094058:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435831936:12345-0@lo:400:kworker.0 Request processed in 73us (3024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583067.094066:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787583067.094140:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435831936:0@lo:400:kworker.0 00000100:00100000:3.0:1787583067.094648:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435832192 00000100:00100000:3.0:1787583067.094654:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435832192 00000100:00100000:3.0:1787583067.094692:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787583067.094701:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435832192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583067.094750:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435832192:12345-0@lo:400:kworker.0 Request processed in 50us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583067.094756:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1787583067.094789:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787583067.094794:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787583067.094808:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787583067.094932:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435832192:0@lo:400:kworker.0 00010000:00010000:3.0:1787583067.535623:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583067.600463:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787583067.600488:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435833344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787583067.600556:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583067.600667:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435833344 00000100:00100000:2.0:1787583067.600675:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435833344 00000100:00100000:2.0:1787583067.600731:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787583067.600742:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435833344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583067.600778:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583067.600830:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435833344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583067.600837:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1787583067.600927:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245ae5880 x1874416435833344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583067.600948:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435833344:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787583068.561679:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787583069.471484:0:13691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787583069.582189:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583069.968877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583069.968913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583069.968941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583069.968965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583069.968983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583069.969020:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583069.969158:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413730432 00000100:00100000:1.0:1787583069.969167:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413730432 00000100:00100000:1.0:1787583069.969226:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:1.0:1787583069.969236:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413730432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583069.969311:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413730432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 77us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583069.969318:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:1.0:1787583069.969342:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413730048 00000100:00100000:1.0:1787583069.969345:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413730048 00000100:00100000:1.0:1787583069.969369:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 336 00000100:00100000:1.0:1787583069.969374:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413730048:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583069.969399:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413730048:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583069.969405:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 336 00000100:00100000:1.0:1787583069.969428:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413730176 00000100:00100000:1.0:1787583069.969432:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413730176 00000100:00100000:1.0:1787583069.969451:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413730688 00000100:00100000:1.0:1787583069.969454:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413730688 00000100:00100000:1.0:1787583069.969464:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413730304 00000100:00100000:1.0:1787583069.969467:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413730304 00000100:00100000:1.0:1787583069.969477:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413730560 00000100:00100000:1.0:1787583069.969479:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413730560 00000100:00100000:1.0:1787583069.969491:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:1.0:1787583069.969498:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:2406:x1874416413730176:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583069.969527:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:2406:x1874416413730176:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583069.969548:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:1.0:1787583069.969560:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:1.0:1787583069.969566:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413730688:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583069.969588:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413730688:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583069.969595:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:1.0:1787583069.969604:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:1.0:1787583069.969610:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413730304:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583069.969629:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413730304:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 19us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583069.969635:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:1.0:1787583069.969645:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:1.0:1787583069.969651:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413730560:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583069.969673:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413730560:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583069.969680:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00080000:3.0:1787583069.970065:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787583069.970069:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787583069.970071:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583070.160464:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435833472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787583070.160551:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583070.160726:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435833472 00000100:00100000:3.0:1787583070.160735:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435833472 00000100:00100000:3.0:1787583070.160801:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787583070.160811:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435833472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787583070.160861:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787583070.160925:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435833472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583070.160932:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787583070.161155:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435833472:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1787583070.594727:0:13739:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb0806080 20000000:00000080:3.0:1787583070.594756:0:13739:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90936f107400 uarg=0000000000000000 20000000:01000000:3.0:1787583070.594801:0:13739:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787583070.594810:0:13739:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787583070.594814:0:13739:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787583070.595692:0:13740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787583070.596292:0:13739:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787583070.603510:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787583070.603763:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787583070.603783:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787583070.603799:0:13739:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787583070.603818:0:13739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.603834:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367f800/0x19a47956376b62a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b62a2 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.603841:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367f400/0x19a47956376b62b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b62b0 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.604624:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924770ba00/0x19a47956376b62c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b62be expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.604632:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909344dede00/0x19a47956376b62d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b62cc expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.604641:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90936367f000/0x19a47956376b62da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4114 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.604649:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924770a800/0x19a47956376b62e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c411b expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.604656:0:13739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.604698:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924770a800/0x19a47956376b62e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c411b expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.604711:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90924770a800/0x19a47956376b62e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c411b expref: 12 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583070.604751:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f14a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874416435833600:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583070.604921:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367f000/0x19a47956376b62da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4114 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.604931:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90936367f000/0x19a47956376b62da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4114 expref: 12 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583070.604940:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874416435833728:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583070.604971:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909344dede00/0x19a47956376b62d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b62cc expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.604979:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff909344dede00/0x19a47956376b62d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b62cc expref: 23 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583070.604987:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874416435833856:0@lo:104: 00000100:00100000:3.0:1787583070.605029:0:13739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787583070.605065:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924770ba00/0x19a47956376b62c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b62be expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.605073:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90924770ba00/0x19a47956376b62c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b62be expref: 23 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583070.605081:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351692d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874416435833984:0@lo:104: 00000100:00100000:2.0:1787583070.605083:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787583070.605094:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435833856 00000100:00100000:3.0:1787583070.605099:0:13739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583070.605101:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435833856 00000100:00100000:3.0:1787583070.605123:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435833984 00000100:00100000:3.0:1787583070.605126:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435833984 00000100:00100000:2.0:1787583070.605137:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787583070.605150:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f146850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+4:13739:x1874416435833856:12345-0@lo:104: 00010000:00010000:2.0:1787583070.605162:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b62d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.605167:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367f400/0x19a47956376b62b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b62b0 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.605179:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90936367f400/0x19a47956376b62b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b62b0 expref: 23 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583070.605187:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351690700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874416435834112:0@lo:104: 00000100:00100000:3.0:1787583070.605207:0:13739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787583070.605208:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787583070.605213:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f146850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+4:13739:x1874416435833856:12345-0@lo:104: Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583070.605220:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787583070.605223:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787583070.605228:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1787583070.605247:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90936367f800/0x19a47956376b62a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b62a2 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.605255:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90936367f800/0x19a47956376b62a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b62a2 expref: 23 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583070.605262:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874416435834240:0@lo:104: 00000100:00100000:2.0:1787583070.605269:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435834112 00000100:00100000:2.0:1787583070.605272:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435834112 00000100:00100000:3.0:1787583070.605283:0:13739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583070.605285:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787583070.605291:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+4:13739:x1874416435833984:12345-0@lo:104: 00000100:00100000:3.0:1787583070.605293:0:13739:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7480 going to sleep for 11 seconds 00010000:00010000:2.0:1787583070.605303:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b62c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583070.605310:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874416435833856:0@lo:104: 00010000:00010000:3.0:1787583070.605334:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583070.605341:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b62d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.605348:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dece00 already unused, calling callback (ffffffffc118ec20) 00010000:00010000:2.0:1787583070.605351:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:3.0:1787583070.605352:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b62d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583070.605356:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+4:13739:x1874416435833984:12345-0@lo:104: Request processed in 65us (255us total) trans 0 rc 0/0 00010000:00010000:3.0:1787583070.605360:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b62d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583070.605361:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 10000000:00010000:3.0:1787583070.605367:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b62d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583070.605371:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435834240 00000100:00100000:2.0:1787583070.605375:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435834240 10000000:01000000:3.0:1787583070.605378:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787583070.605387:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787583070.605392:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+4:13739:x1874416435834112:12345-0@lo:104: 00010000:00010000:2.0:1787583070.605399:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b62b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.605403:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b62d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.605409:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787583070.605425:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1787583070.605428:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b62d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583070.605430:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+4:13739:x1874416435834112:12345-0@lo:104: Request processed in 38us (222us total) trans 0 rc 0/0 00010000:00010000:3.0:1787583070.605435:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b62cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b62d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583070.605436:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787583070.605447:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1787583070.605448:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787583070.605451:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b62c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583070.605452:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+3:13739:x1874416435834240:12345-0@lo:104: 00010000:00010000:3.0:1787583070.605457:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e000 already unused, calling callback (ffffffffc118ec20) 00010000:00010000:2.0:1787583070.605459:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b62a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787583070.605460:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b62c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.605468:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b62c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787583070.605473:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b62c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583070.605479:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787583070.605485:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787583070.605490:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5bddce63-0a65-4d1b-a395-d8312cc42532+3:13739:x1874416435834240:12345-0@lo:104: Request processed in 38us (206us total) trans 0 rc 0/0 00010000:00010000:3.0:1787583070.605491:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b62c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.605496:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787583070.605496:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1787583070.605510:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787583070.605518:0:10405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b62b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.605524:0:10405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787583070.605527:0:10405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b62b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.605534:0:10405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b62b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787583070.605540:0:10405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b62b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583070.605545:0:10405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787583070.605560:0:10405:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b62b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.605565:0:10405:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787583070.605580:0:10405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b62b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.605587:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90936367e200/0x19a47956376b62b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b62b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.605596:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583070.605599:0:10405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b62a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.605605:0:10405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787583070.605607:0:10405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b62a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.605624:0:10405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b62a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.605625:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b62c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787583070.605631:0:10405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b62a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.605632:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90936367e000/0x19a47956376b62be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b62c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583070.605637:0:10405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787583070.605641:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583070.605643:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583070.605644:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583070.605650:0:10405:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b62a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.605655:0:10405:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787583070.605660:0:10405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b62a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583070.605662:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351692d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874416435833984:0@lo:104: 00010000:00010000:2.0:1787583070.605667:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344dec800/0x19a47956376b62a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b62a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583070.605669:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351690700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874416435834112:0@lo:104: 00000100:00100000:3.0:1787583070.605675:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874416435834240:0@lo:104: 00010000:00010000:2.0:1787583070.605679:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583070.605680:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583070.605682:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583070.605696:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583070.605699:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435834624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787583070.605703:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435834368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787583070.605725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583070.605762:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787583070.605768:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435834496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787583070.605787:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583070.605809:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435834624 00000100:00100000:2.0:1787583070.605813:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435834624 00000100:00100000:3.0:1787583070.605815:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787583070.605829:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367f400/0x19a47956376b62b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b62b0 expref: 24 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583070.605876:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435834496 00000100:00100000:3.0:1787583070.605926:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787583070.605932:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435834752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787583070.605954:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583070.605972:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435834368 00000100:00100000:3.0:1787583070.605975:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435834368 00010000:00010000:3.0:1787583070.605989:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909344dede00/0x19a47956376b62d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b62cc expref: 25 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583070.606002:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435834752 00000100:00100000:3.0:1787583070.606004:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435834752 00000100:00100000:2.0:1787583070.606006:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435834496 00010000:00010000:3.0:1787583070.606014:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367f800/0x19a47956376b62a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b62a2 expref: 27 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.606019:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924770ba00/0x19a47956376b62c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b62be expref: 27 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583070.606026:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787583070.606038:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+27:3653:x1874416435834624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787583070.606048:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583070.606053:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367f400/0x19a47956376b62b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b62b0 expref: 27 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.606062:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367f400/0x19a47956376b62b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b62b0 expref: 27 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.606074:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367f400/0x19a47956376b62b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b62b0 expref: 27 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.606086:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583070.606095:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583070.606112:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+26:3653:x1874416435834624:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583070.606695:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787583070.606704:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+26:3656:x1874416435834368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787583070.606712:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583070.606717:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909344dede00/0x19a47956376b62d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b62cc expref: 26 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.606725:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909344dede00/0x19a47956376b62d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b62cc expref: 26 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.606746:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344dede00/0x19a47956376b62d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b62cc expref: 26 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.606755:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583070.606789:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+25:3656:x1874416435834368:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583070.606795:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787583070.606811:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787583070.606817:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435834752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787583070.606826:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583070.606831:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367f800/0x19a47956376b62a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b62a2 expref: 24 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.606839:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367f800/0x19a47956376b62a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b62a2 expref: 24 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.606877:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367f800/0x19a47956376b62a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b62a2 expref: 24 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583070.606977:0:6513:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787583070.606985:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:0.0:1787583070.607050:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583070.607100:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787583070.607111:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435834496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583070.607120:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583070.607125:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924770ba00/0x19a47956376b62c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b62be expref: 24 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.607145:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924770ba00/0x19a47956376b62c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b62be expref: 24 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.607155:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924770ba00/0x19a47956376b62c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b62be expref: 24 pid: 6520 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.607164:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583070.607190:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+23:3653:x1874416435834496:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583070.607196:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787583070.607333:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787583070.607369:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435834496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787583070.607379:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435834624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787583070.607407:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435834368:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787583070.610999:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583070.611148:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bddce63-0a65-4d1b-a395-d8312cc42532+20:3656:x1874416435834752:12345-0@lo:103:ldlm_bl.0 Request processed in 4327us (5189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583070.611160:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787583070.611236:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435834752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583070.611272:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f14a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874416435833600:192.168.203.11@tcp:104: 00000100:00100000:1.0:1787583070.611287:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874416435833728:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583070.611317:0:13739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787583070.613957:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1787583070.613971:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1787583070.614206:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b636d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614217:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b636d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614224:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b636d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614231:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583070.614236:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b636d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614244:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b636d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614275:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d0a4730 (ffff90935a4d4300) 00010000:00010000:1.0:1787583070.614278:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583070.614283:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b636d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614289:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b636d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614306:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6382 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614323:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6382 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614328:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6382 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614333:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583070.614336:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6382 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614341:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6382 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614348:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9093516fbf00) 00010000:00010000:1.0:1787583070.614350:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583070.614353:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6382 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614358:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6382 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614397:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b63eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614403:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b63eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614409:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b63eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614413:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583070.614416:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b63eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614422:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b63eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614430:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d0a4730 (ffff90935a4d4300) 00010000:00010000:1.0:1787583070.614432:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583070.614434:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b63eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614439:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b63eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614450:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6407 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614456:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6407 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614461:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6407 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614471:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583070.614475:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6407 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614480:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6407 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614488:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9093516fb400) 00010000:00010000:1.0:1787583070.614490:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583070.614492:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6407 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.614497:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6407 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583070.614947:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435834880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787583070.615012:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583070.615188:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435834880 00000100:00100000:1.0:1787583070.615195:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435834880 00000100:00100000:1.0:1787583070.615289:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787583070.615300:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435834880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787583070.615327:0:8752:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1787583070.615359:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8c5a58, atime: 0x6a8c5a58, ctime: 0x6a8c5a58, blocks: 0x0 00010000:00010000:1.0:1787583070.615366:0:8752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006317b11f/0x19a47956376b641c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.615380:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787583070.615385:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583070.615391:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006317b11f/0x19a47956376b641c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.615421:0:8752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006317b11f/0x19a47956376b641c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.615431:0:8752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006317b11f/0x19a47956376b641c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.615438:0:8752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006317b11f/0x19a47956376b641c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583070.615462:0:8752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787583070.615632:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3656:x1874416435834880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 334us (619us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787583070.615640:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787583070.615689:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583070.615695:0:10405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006317b11f/0x19a47956376b641c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.615704:0:10405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583070.615708:0:10405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006317b11f/0x19a47956376b641c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.615716:0:10405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006317b11f/0x19a47956376b641c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.615732:0:10405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006317b11f/0x19a47956376b641c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.615752:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006317b11f/0x19a47956376b641c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.615769:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583070.615776:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583070.615778:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787583070.616101:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787583070.616136:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff909245ae7800/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787583070.616143:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435834880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787583070.623549:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583070.623642:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583070.623939:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413730944 00000100:00100000:2.0:1787583070.623949:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413730944 00010000:00010000:2.0:1787583070.623998:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90936367f000/0x19a47956376b62da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4114 expref: 13 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583070.624042:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413730816 00000100:00100000:2.0:1787583070.624046:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413730816 00010000:00010000:2.0:1787583070.624059:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924770a800/0x19a47956376b62e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c411b expref: 14 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583070.625190:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1787583070.625206:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa77711a-a697-4098-9892-32db59b6905c+14:2406:x1874416413730944:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583070.625222:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583070.625229:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90936367f000/0x19a47956376b62da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4114 expref: 14 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.625246:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90936367f000/0x19a47956376b62da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4114 expref: 14 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583070.625288:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00010000:00010000:2.0:1787583070.626122:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367f000/0x19a47956376b62da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4114 expref: 14 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583070.626138:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583070.626205:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413730944:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1004us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583070.626213:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:0.0:1787583070.626940:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa77711a-a697-4098-9892-32db59b6905c+12:2406:x1874416413730816:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583070.626956:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583070.626963:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924770a800/0x19a47956376b62e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c411b expref: 12 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583070.626974:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924770a800/0x19a47956376b62e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c411b expref: 12 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583070.626986:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924770a800/0x19a47956376b62e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c411b expref: 12 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583070.627000:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583070.627026:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583070.627041:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583070.627047:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583070.627053:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583070.627059:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583070.627065:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec200 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583070.627069:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583070.627077:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583070.627102:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583070.627113:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583070.627149:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa77711a-a697-4098-9892-32db59b6905c+11:2406:x1874416413730816:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1852us (3506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583070.627161:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00010000:00010000:3.0:1787583070.627217:0:13739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.627228:0:13739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583070.627242:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344dec200/0x19a47956376b6415 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583071.184689:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435835008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787583071.184794:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583071.184962:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435835008 00000100:00100000:2.0:1787583071.184969:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435835008 00000100:00100000:2.0:1787583071.185028:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787583071.185213:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435835008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583071.185247:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583071.185308:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435835008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 272us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583071.185316:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787583071.185398:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435835008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583071.186120:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435835136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583071.186163:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583071.186207:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435835136 00000100:00100000:3.0:1787583071.186214:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435835136 00000100:00100000:3.0:1787583071.187406:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787583071.187424:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435835136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787583071.187451:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787583071.187782:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583071.190954:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435835136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3527us (4779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583071.190968:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787583071.195492:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435835136:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1787583071.626358:0:13791:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9f9b1fc0 20000000:00000080:0.0:1787583071.626376:0:13791:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff909247c7c400 uarg=0000000000000000 20000000:01000000:0.0:1787583071.626421:0:13791:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787583071.626429:0:13791:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787583071.626435:0:13791:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1787583071.627302:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1787583071.627415:0:13791:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1787583071.627512:0:13791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1787583071.627542:0:13791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1787583071.627561:0:13791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1787583071.627574:0:13791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787583071.627609:0:13791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90924713f800/0x19a47956376b6423 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.627626:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713f800/0x19a47956376b6423 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.627636:0:13791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90924713f800/0x19a47956376b6423 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.627643:0:13791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90924713f800/0x19a47956376b6423 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.627650:0:13791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90924713f800/0x19a47956376b6423 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.627657:0:13791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90924713f800/0x19a47956376b6423 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.627662:0:13791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583071.627667:0:13791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90924713f800/0x19a47956376b6423 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.627684:0:13791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90924713f800/0x19a47956376b6423 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.627698:0:13791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90924713f800/0x19a47956376b6423 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.627706:0:13791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90924713f800/0x19a47956376b6423 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.627712:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713f800/0x19a47956376b6423 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583071.630430:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583071.887403:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583071.889284:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413731072 00000100:00100000:0.0:1787583071.889489:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413731072 00000100:00100000:2.0:1787583071.889715:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 337 00000100:00100000:2.0:1787583071.889737:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+11:6178:x1874416413731072:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583071.889754:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583071.889775:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924770b400/0x19a47956376b642a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4168 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583071.889813:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924770b400/0x19a47956376b642a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4168 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583071.889826:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924770b400/0x19a47956376b642a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4168 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583071.889835:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770b400, rc 0) 00000100:00100000:2.0:1787583071.889921:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+12:6178:x1874416413731072:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 196us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583071.889928:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 337 00000100:00100000:2.0:1787583071.893792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583071.900813:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413731200 00000100:00100000:1.0:1787583071.900829:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413731200 00000100:00100000:1.0:1787583071.901002:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 338 00000100:00100000:1.0:1787583071.901014:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+12:6178:x1874416413731200:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583071.901234:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+12:6178:x1874416413731200:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 222us (7451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583071.901242:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 338 00000100:00100000:3.0:1787583071.907958:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583071.908337:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413731328 00000100:00100000:2.0:1787583071.908348:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413731328 00000100:00100000:2.0:1787583071.908411:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 339 00000100:00100000:2.0:1787583071.908423:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+12:6178:x1874416413731328:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787583071.908609:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+12:6178:x1874416413731328:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 187us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583071.908618:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 339 00000100:00100000:3.0:1787583071.924739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583071.924881:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413731456 00000100:00100000:1.0:1787583071.924891:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413731456 00000100:00100000:1.0:1787583071.924954:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 340 00000100:00100000:1.0:1787583071.924964:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+12:10801:x1874416413731456:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787583071.925119:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+12:10801:x1874416413731456:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 156us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583071.925128:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 340 00000100:00100000:3.0:1787583071.932248:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583071.932574:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413731584 00000100:00100000:1.0:1787583071.932584:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413731584 00000100:00100000:1.0:1787583071.932649:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 341 00000100:00100000:1.0:1787583071.932660:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+12:10801:x1874416413731584:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787583071.932918:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+12:10801:x1874416413731584:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 258us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583071.932926:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 341 00000100:00100000:3.0:1787583071.948580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583071.948967:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413731712 00000100:00100000:0.0:1787583071.948979:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413731712 00000100:00100000:0.0:1787583071.949041:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 342 00000100:00100000:0.0:1787583071.949051:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+12:6178:x1874416413731712:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787583071.949068:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583071.949087:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713f800/0x19a47956376b6431 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c416f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.949125:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713f800/0x19a47956376b6431 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c416f expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.949136:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713f800/0x19a47956376b6431 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c416f expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583071.949146:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f800, rc 0) 00000100:00100000:0.0:1787583071.949219:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:6178:x1874416413731712:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 170us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583071.949227:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 342 00000100:00100000:2.0:1787583071.953831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583071.954061:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413731840 00000100:00100000:3.0:1787583071.954072:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413731840 00000100:00100000:3.0:1787583071.954133:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 343 00000100:00100000:3.0:1787583071.954144:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:6178:x1874416413731840:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583071.954308:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:6178:x1874416413731840:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 166us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583071.954316:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 343 00000100:00100000:3.0:1787583071.956001:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583071.956152:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413731968 00000100:00100000:1.0:1787583071.956160:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413731968 00000100:00100000:1.0:1787583071.956210:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 344 00000100:00100000:1.0:1787583071.956220:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:6178:x1874416413731968:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787583071.956361:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:6178:x1874416413731968:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 141us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583071.956368:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 344 00000100:00100000:2.0:1787583071.966097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583071.966293:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413732096 00000100:00100000:3.0:1787583071.966316:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413732096 00000100:00100000:3.0:1787583071.966370:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 345 00000100:00100000:3.0:1787583071.966379:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:10804:x1874416413732096:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787583071.966525:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:10804:x1874416413732096:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 146us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583071.966539:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 345 00000100:00100000:2.0:1787583071.969460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583071.969789:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413732224 00000100:00100000:0.0:1787583071.969807:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413732224 00000100:00100000:0.0:1787583071.969912:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 346 00000100:00100000:0.0:1787583071.969923:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:10804:x1874416413732224:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787583071.970095:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:10804:x1874416413732224:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 172us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583071.970103:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 346 10000000:01000000:2.0:1787583072.013989:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787583072.013998:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936db2f000 from 7 10000000:01000000:2.0:1787583072.014002:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787583072.014063:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583072.014076:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583072.014088:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583072.014115:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435835264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787583072.014187:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.014268:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d4e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787583072.014991:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435835264 00000100:00100000:1.0:1787583072.015001:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435835264 00000100:00100000:1.0:1787583072.015061:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1787583072.015079:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+20:6525:x1874416435835264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583072.015093:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583072.015108:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909247c52e00/0x19a47956376b643f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6438 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583072.015133:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909247c52e00/0x19a47956376b643f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6438 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583072.015144:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909247c52e00/0x19a47956376b643f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6438 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583072.015153:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52e00, rc 0) 00000100:00100000:1.0:1787583072.015210:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435835264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583072.015216:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787583072.015426:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435835264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583072.015443:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583072.015453:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583072.015552:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435835392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787583072.015579:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.015652:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d4e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787583072.015688:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435835392 00000100:00100000:3.0:1787583072.015693:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435835392 00000100:00100000:3.0:1787583072.015890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787583072.015900:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435835392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583072.016040:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435835392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583072.016046:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787583072.016105:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435835392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787583072.016131:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435835520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787583072.016169:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.017638:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d4e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787583072.017687:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435835520 00000100:00100000:1.0:1787583072.017696:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435835520 00000100:00100000:3.0:1787583072.017784:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787583072.017805:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435835520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583072.018539:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435835520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 734us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583072.018549:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787583072.018654:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435835520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787583072.018933:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13804:1874416435835648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583072.018996:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.019449:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d4e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787583072.019509:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435835648 00000100:00100000:0.0:1787583072.019516:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435835648 00000100:00100000:0.0:1787583072.019548:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787583072.019556:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:13804:x1874416435835648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787583072.022446:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:13804:x1874416435835648:12345-0@lo:502:llog_process_th.0 Request processed in 2881us (3442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.022461:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787583072.023220:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13804:1874416435835648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787583072.023260:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787583072.023272:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583072.023274:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787583072.023282:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90936db2f000 00000020:00000080:2.0:1787583072.023284:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787583072.023349:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787583072.023353:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583072.023354:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787583072.023357:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787583072.023359:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583072.023361:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787583072.023364:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90936db2f000 00000020:00000080:2.0:1787583072.023366:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787583072.023426:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13804:1874416435835776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583072.023483:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.023517:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d4e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787583072.024917:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435835776 00000100:00100000:1.0:1787583072.024928:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435835776 00000100:00100000:1.0:1787583072.025145:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787583072.025155:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:13804:x1874416435835776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787583072.025356:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:13804:x1874416435835776:12345-0@lo:502:llog_process_th.0 Request processed in 202us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583072.025364:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787583072.033236:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13804:1874416435835776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787583072.033284:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787583072.033296:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583072.033299:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787583072.033306:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787583072.033493:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787583072.033519:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787583072.033530:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583072.033541:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583072.033553:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787583072.033564:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936d948800 from 7 10000000:01000000:3.0:1787583072.033567:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787583072.033601:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583072.033608:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583072.033617:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583072.033638:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435835904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787583072.033701:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583072.034322:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0fecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583072.034365:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435835904 00000100:00100000:1.0:1787583072.034372:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435835904 00000100:00100000:1.0:1787583072.034440:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787583072.034450:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+21:6525:x1874416435835904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583072.034464:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583072.034478:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909247c53a00/0x19a47956376b644d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6446 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583072.034504:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909247c53a00/0x19a47956376b644d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6446 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583072.034515:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909247c53a00/0x19a47956376b644d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6446 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583072.034524:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53a00, rc 0) 00000100:00100000:1.0:1787583072.034571:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435835904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583072.034577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787583072.035115:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435835904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787583072.035129:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583072.035138:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583072.035224:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435836032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583072.035255:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583072.035287:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0fecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583072.036106:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435836032 00000100:00100000:2.0:1787583072.036115:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435836032 00000100:00100000:2.0:1787583072.036156:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787583072.036163:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435836032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787583072.036285:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435836032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583072.036291:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787583072.036663:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435836032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583072.036721:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435836160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583072.036779:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583072.037174:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0fecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583072.042059:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435836160 00000100:00100000:1.0:1787583072.042072:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435836160 00000100:00100000:1.0:1787583072.042136:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787583072.042146:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435836160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787583072.042306:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435836160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (5525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583072.042314:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787583072.042499:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435836160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583072.042766:0:13807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13807:1874416435836288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787583072.042822:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583072.042882:0:13807:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0fe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583072.043122:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435836288 00000100:00100000:2.0:1787583072.043129:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435836288 00000100:00100000:2.0:1787583072.043174:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787583072.043183:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:13807:x1874416435836288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583072.043308:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+22:13807:x1874416435836288:12345-0@lo:502:llog_process_th.0 Request processed in 126us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583072.043316:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787583072.043686:0:13807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13807:1874416435836288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787583072.043717:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583072.043741:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583072.043744:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787583072.043752:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90936d948800 00000020:00000080:3.0:1787583072.043755:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787583072.043816:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583072.043820:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583072.043822:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787583072.043825:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583072.043828:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583072.043829:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787583072.043832:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90936d948800 00000020:00000080:3.0:1787583072.043834:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787583072.043898:0:13807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13807:1874416435836416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787583072.043937:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583072.043960:0:13807:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0fe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583072.044506:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435836416 00000100:00100000:2.0:1787583072.044514:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435836416 00000100:00100000:2.0:1787583072.044549:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787583072.044557:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:13807:x1874416435836416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583072.044659:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:13807:x1874416435836416:12345-0@lo:502:llog_process_th.0 Request processed in 102us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583072.044674:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787583072.044917:0:13807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13807:1874416435836416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787583072.044944:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583072.044949:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583072.044951:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787583072.044955:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787583072.045138:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787583072.045165:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787583072.045176:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583072.045187:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583072.045199:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787583072.045201:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90936d90b000 from 7 10000000:01000000:2.0:1787583072.045205:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787583072.045355:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583072.045532:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583072.045542:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583072.045562:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435836544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787583072.045605:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.045629:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d4e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583072.045774:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435836544 00000100:00100000:3.0:1787583072.045780:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435836544 00000100:00100000:3.0:1787583072.045829:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787583072.045838:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+22:6525:x1874416435836544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787583072.045872:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583072.045884:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344dece00/0x19a47956376b645b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6454 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583072.045905:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344dece00/0x19a47956376b645b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6454 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583072.045915:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344dece00/0x19a47956376b645b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6454 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583072.045922:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dece00, rc 0) 00000100:00100000:3.0:1787583072.045966:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435836544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583072.045972:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787583072.048263:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435836544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787583072.048289:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583072.048301:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583072.048383:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435836672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787583072.048443:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583072.048558:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a1d5240 going to sleep for 11 seconds 00000100:00100000:3.0:1787583072.049553:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435836672 00000100:00100000:3.0:1787583072.049562:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435836672 00000100:00100000:3.0:1787583072.049671:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787583072.049683:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435836672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583072.049878:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435836672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583072.049886:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787583072.051949:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435836672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583072.052077:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435836800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583072.052156:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583072.052310:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0fecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583072.052575:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435836800 00000100:00100000:2.0:1787583072.052583:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435836800 00000100:00100000:2.0:1787583072.052661:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787583072.052672:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435836800:12345-0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787583072.052765:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787583072.052819:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435836800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583072.052835:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787583072.053072:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435836800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583072.056094:0:13809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13809:1874416435836928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787583072.056177:0:13809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583072.056767:0:13809:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0fed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787583072.057657:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435836928 00000100:00100000:0.0:1787583072.057668:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435836928 00000100:00100000:0.0:1787583072.057748:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787583072.057758:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:13809:x1874416435836928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787583072.057927:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:13809:x1874416435836928:12345-0@lo:502:llog_process_th.0 Request processed in 169us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.057935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787583072.057948:0:13809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13809:1874416435836928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787583072.058059:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583072.058069:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583072.058072:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787583072.058078:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90936d90b000 00000020:00000080:3.0:1787583072.058081:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787583072.058133:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583072.058137:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583072.058138:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787583072.058141:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583072.058146:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583072.058147:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787583072.058150:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90936d90b000 00000020:00000080:3.0:1787583072.058153:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787583072.060646:0:13809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13809:1874416435837056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787583072.060748:0:13809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583072.061320:0:13809:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d13cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583072.061399:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435837056 00000100:00100000:2.0:1787583072.061408:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435837056 00000100:00100000:2.0:1787583072.061465:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787583072.061620:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:13809:x1874416435837056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583072.063661:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:13809:x1874416435837056:12345-0@lo:502:llog_process_th.0 Request processed in 2035us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583072.063675:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1787583072.064430:0:13809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13809:1874416435837056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787583072.064603:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583072.064612:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583072.064614:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787583072.064619:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787583072.064985:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787583072.065024:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787583072.065035:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583072.065047:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583072.065057:0:6525:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787583072.065060:0:6525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff909348740800 from 7 10000000:01000000:2.0:1787583072.065063:0:6525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787583072.065098:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583072.065106:0:6525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583072.065116:0:6525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583072.065137:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435837184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787583072.065213:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.065781:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d4ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787583072.065944:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435837184 00000100:00100000:0.0:1787583072.065952:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435837184 00000100:00100000:0.0:1787583072.066005:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787583072.066017:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+23:6525:x1874416435837184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787583072.066031:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583072.066044:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713ee00/0x19a47956376b6469 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b6462 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583072.066067:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713ee00/0x19a47956376b6469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b6462 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583072.066079:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713ee00/0x19a47956376b6469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b6462 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583072.066086:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713ee00, rc 0) 00000100:00100000:0.0:1787583072.066140:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435837184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.066147:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1787583072.066350:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435837184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583072.066365:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583072.066375:0:6525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583072.066435:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435837312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787583072.066463:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.066500:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d4ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787583072.066554:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435837312 00000100:00100000:3.0:1787583072.066559:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435837312 00000100:00100000:3.0:1787583072.066605:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787583072.066612:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435837312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583072.066739:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435837312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583072.066746:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787583072.066776:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435837312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787583072.066809:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435837440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787583072.066864:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.066880:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d4ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787583072.066927:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435837440 00000100:00100000:0.0:1787583072.066932:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435837440 00000100:00100000:0.0:1787583072.066953:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787583072.066967:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435837440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787583072.067056:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:6525:x1874416435837440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.067065:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787583072.067079:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5bddce63-0a65-4d1b-a395-d8312cc42532:6525:1874416435837440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787583072.067523:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13811:1874416435837568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583072.067569:0:13811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.067608:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d4e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583072.067696:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435837568 00000100:00100000:3.0:1787583072.067700:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435837568 00000100:00100000:3.0:1787583072.067741:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1787583072.067749:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:13811:x1874416435837568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787583072.067877:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:13811:x1874416435837568:12345-0@lo:502:llog_process_th.0 Request processed in 128us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583072.067884:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787583072.067947:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13811:1874416435837568:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787583072.067977:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787583072.067987:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583072.067990:0:13811:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787583072.067997:0:13811:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff909348740800 00000020:00000080:0.0:1787583072.068000:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787583072.068066:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787583072.068069:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583072.068071:0:13811:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787583072.068073:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787583072.068075:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583072.068077:0:13811:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787583072.068080:0:13811:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff909348740800 00000020:00000080:0.0:1787583072.068082:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787583072.068116:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13811:1874416435837696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787583072.068151:0:13811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583072.068183:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a1d5240 going to sleep for 11 seconds 00000100:00100000:2.0:1787583072.068598:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435837696 00000100:00100000:2.0:1787583072.068605:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435837696 00000100:00100000:2.0:1787583072.068647:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787583072.068655:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:13811:x1874416435837696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583072.068759:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:13811:x1874416435837696:12345-0@lo:502:llog_process_th.0 Request processed in 106us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583072.068773:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787583072.069258:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5bddce63-0a65-4d1b-a395-d8312cc42532:13811:1874416435837696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787583072.069290:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787583072.069297:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583072.069299:0:13811:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787583072.069304:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787583072.070539:0:6525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787583072.070572:0:6525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787583072.070582:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583072.070593:0:6525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787583072.077244:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787583072.206087:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435838208:0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.206153:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583072.206220:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435838720:0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.206243:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583072.206261:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435839232:0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.206279:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583072.206320:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787583072.206326:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435838080:0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.206352:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583072.206367:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435838592:0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.206384:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583072.206398:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435839104:0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.206415:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583072.206448:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435838208 00000100:00100000:0.0:1787583072.206455:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435838208 00000100:00100000:0.0:1787583072.206498:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787583072.206519:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435838208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.206577:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435838208:12345-0@lo:400:kworker.0 Request processed in 59us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.206584:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787583072.206617:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435838720 00000100:00100000:0.0:1787583072.206620:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435838720 00000100:00100000:0.0:1787583072.206646:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435839232 00000100:00100000:0.0:1787583072.206649:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435839232 00000100:00100000:0.0:1787583072.206659:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435838592 00000100:00100000:0.0:1787583072.206661:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435838592 00000100:00100000:0.0:1787583072.206670:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435839104 00000100:00100000:0.0:1787583072.206672:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435839104 00000100:00100000:0.0:1787583072.206684:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787583072.206690:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874416435838720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.206743:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874416435838720:12345-0@lo:400:kworker.0 Request processed in 52us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.206750:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787583072.206762:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787583072.206768:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435839232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.206803:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435839232:12345-0@lo:400:kworker.0 Request processed in 36us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.206809:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787583072.206819:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787583072.206825:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435838592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.206872:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435838592:12345-0@lo:400:kworker.0 Request processed in 48us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.206878:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787583072.206889:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787583072.206895:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435839104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.206920:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435839104:12345-0@lo:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.206926:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1787583072.206958:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787583072.206962:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583072.206987:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435838592:0@lo:400:kworker.0 00010000:00080000:0.0:1787583072.206999:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15d880 x1874416435839104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583072.207009:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435839104:0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.207017:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435838208:0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.207035:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435838720:0@lo:400:kworker.0 00010000:00080000:0.0:1787583072.207044:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15c700 x1874416435839232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583072.207052:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435839232:0@lo:400:kworker.0 00000100:00100000:1.0:1787583072.207496:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435838080 00000100:00100000:1.0:1787583072.207503:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435838080 00000100:00100000:1.0:1787583072.207536:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787583072.207543:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435838080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583072.207601:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435838080:12345-0@lo:400:kworker.0 Request processed in 59us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583072.207607:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787583072.208061:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435838080:0@lo:400:kworker.0 00000100:00100000:2.0:1787583072.208387:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435837824:0@lo:400:kworker.0 00000100:00100000:2.0:1787583072.208424:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.208456:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435838336:0@lo:400:kworker.0 00000100:00100000:2.0:1787583072.208475:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.208516:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435838848:0@lo:400:kworker.0 00000100:00100000:2.0:1787583072.208546:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.208563:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435839360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583072.208583:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583072.209097:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435837824 00000100:00100000:1.0:1787583072.209103:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435837824 00000100:00100000:1.0:1787583072.209135:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435838336 00000100:00100000:1.0:1787583072.209138:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435838336 00000100:00100000:1.0:1787583072.209153:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435838848 00000100:00100000:1.0:1787583072.209155:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435838848 00000100:00100000:1.0:1787583072.209169:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787583072.209176:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435837824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583072.209216:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435837824:12345-0@lo:400:kworker.0 Request processed in 40us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583072.209222:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787583072.209234:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787583072.209239:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435838336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583072.209261:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435838336:12345-0@lo:400:kworker.0 Request processed in 22us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583072.209267:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787583072.209276:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787583072.209281:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435838848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583072.209408:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435837824:0@lo:400:kworker.0 00000100:00100000:2.0:1787583072.209418:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435838336:0@lo:400:kworker.0 00000100:00100000:2.0:1787583072.209434:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787583072.209440:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435837952:0@lo:400:kworker.0 00000100:00100000:2.0:1787583072.209462:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.209476:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435838464:0@lo:400:kworker.0 00000100:00100000:2.0:1787583072.209526:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.209547:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435838976:0@lo:400:kworker.0 00000100:00100000:2.0:1787583072.209567:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583072.209684:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435838464 00000100:00100000:0.0:1787583072.209689:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435838464 00000100:00100000:0.0:1787583072.209708:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435838976 00000100:00100000:0.0:1787583072.209710:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435838976 00000100:00100000:0.0:1787583072.209739:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787583072.209745:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435838464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.209908:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435838464:12345-0@lo:400:kworker.0 Request processed in 41us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.209917:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787583072.209931:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787583072.209947:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435838976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.209976:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435838976:12345-0@lo:400:kworker.0 Request processed in 40us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.209982:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787583072.209999:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435839360 00000100:00100000:0.0:1787583072.210002:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435839360 00000100:00100000:0.0:1787583072.210032:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435837952 00000100:00100000:0.0:1787583072.210035:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435837952 00000100:00100000:0.0:1787583072.210046:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787583072.210052:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435839360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787583072.210085:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787583072.210115:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435839360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.210121:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787583072.210132:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787583072.210137:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435837952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583072.210163:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435837952:12345-0@lo:400:kworker.0 Request processed in 26us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.210169:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1787583072.210189:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787583072.210192:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787583072.210421:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435838848:12345-0@lo:400:kworker.0 Request processed in 1139us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583072.210429:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787583072.213192:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435839488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583072.213266:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583072.213820:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435837952:0@lo:400:kworker.0 00010000:00080000:2.0:1787583072.213839:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15dc00 x1874416435838464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583072.213864:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435838464:0@lo:400:kworker.0 00010000:00080000:2.0:1787583072.213876:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15f480 x1874416435838976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583072.213885:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435838976:0@lo:400:kworker.0 00000100:00100000:2.0:1787583072.213896:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435838848:0@lo:400:kworker.0 00000100:00100000:2.0:1787583072.213914:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435839360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787583072.214226:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435839488 00000100:00100000:0.0:1787583072.214233:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435839488 00000100:00100000:0.0:1787583072.214282:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787583072.214291:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435839488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787583072.215285:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787583072.215432:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435839488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1140us (2165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583072.215443:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1787583072.215472:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092477dd500 x1874416435839488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583072.215559:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435839488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787583072.654478:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583072.718388:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435839616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583072.718488:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583072.720946:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435839616 00000100:00100000:3.0:1787583072.720968:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435839616 00000100:00100000:3.0:1787583072.721084:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787583072.721095:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435839616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787583072.721120:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583072.721214:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435839616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583072.721221:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1787583072.722141:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247da4700 x1874416435839616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583072.722163:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435839616:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1787583073.102675:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787583073.105655:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787583073.679088:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583074.702101:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583075.087247:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583075.087293:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583075.087322:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583075.087354:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583075.087373:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583075.087392:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583075.087420:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413732480 00000100:00100000:0.0:1787583075.087445:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413732480 00000100:00100000:0.0:1787583075.087511:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413732992 00000100:00100000:0.0:1787583075.087515:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413732992 00000100:00100000:0.0:1787583075.087528:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413732608 00000100:00100000:0.0:1787583075.087531:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413732608 00000100:00100000:0.0:1787583075.087541:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413732864 00000100:00100000:0.0:1787583075.087543:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413732864 00000100:00100000:0.0:1787583075.087559:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 220 00000100:00100000:0.0:1787583075.087569:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413732480:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583075.087638:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413732480:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 70us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583075.087656:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 220 00000100:00100000:0.0:1787583075.087674:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:0.0:1787583075.087682:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413732992:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583075.087720:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413732992:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583075.087726:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:0.0:1787583075.087739:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:0.0:1787583075.087745:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413732608:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583075.087767:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413732608:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583075.087772:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:0.0:1787583075.087781:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:0.0:1787583075.087786:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413732864:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583075.087806:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413732864:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 20us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583075.087819:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00080000:0.0:1787583075.087835:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787583075.087838:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583075.088127:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413732352 00000100:00100000:2.0:1787583075.088133:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413732352 00000100:00100000:2.0:1787583075.088172:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 367 00000100:00100000:2.0:1787583075.088179:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413732352:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583075.088206:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413732352:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583075.088212:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 367 00000100:00100000:3.0:1787583075.088535:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413732736 00000100:00100000:3.0:1787583075.088540:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413732736 00000100:00100000:3.0:1787583075.088592:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:3.0:1787583075.088600:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413732736:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:1.0:1787583075.088766:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583075.088907:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413732736:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 306us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583075.088917:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:0.0:1787583075.278193:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435839744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787583075.278281:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583075.278439:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435839744 00000100:00100000:2.0:1787583075.278447:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435839744 00000100:00100000:2.0:1787583075.278504:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787583075.278528:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435839744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787583075.278562:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787583075.278614:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435839744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583075.278621:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787583075.278670:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435839744:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787583075.729365:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583076.302070:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435839872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583076.302155:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583076.302267:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435839872 00000100:00100000:0.0:1787583076.302276:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435839872 00000100:00100000:0.0:1787583076.302336:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787583076.302346:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435839872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787583076.302375:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787583076.302450:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583076.303625:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435840000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583076.303670:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583076.303742:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435840000 00000100:00100000:1.0:1787583076.303747:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435840000 00000100:00100000:1.0:1787583076.303787:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787583076.303796:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435840000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787583076.303811:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583076.303868:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435840000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583076.303875:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1787583076.303894:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583076.303928:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435840000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787583076.311079:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435839872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8724us (8924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583076.311095:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787583076.313668:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435839872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787583076.750201:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787583076.818189:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1787583077.326391:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435840512:0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.326463:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583077.326527:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435841024:0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.326553:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583077.326570:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435841536:0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.326610:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583077.326642:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787583077.326648:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435840384:0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.326674:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583077.326704:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435840896:0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.326726:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583077.326741:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435841408:0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.326759:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583077.326878:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435840256:0@lo:400:kworker.0 00000100:00100000:3.0:1787583077.326908:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583077.326929:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435840768:0@lo:400:kworker.0 00000100:00100000:3.0:1787583077.326950:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583077.326960:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435840128:0@lo:400:kworker.0 00000100:00100000:3.0:1787583077.326969:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435841280:0@lo:400:kworker.0 00000100:00100000:0.0:1787583077.327054:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435840512 00000100:00100000:0.0:1787583077.327062:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435840512 00000100:00100000:0.0:1787583077.327099:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435840896 00000100:00100000:0.0:1787583077.327102:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435840896 00000100:00100000:0.0:1787583077.327126:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435841408 00000100:00100000:0.0:1787583077.327129:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435841408 00000100:00100000:0.0:1787583077.327139:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435840256 00000100:00100000:0.0:1787583077.327141:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435840256 00000100:00100000:0.0:1787583077.327167:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435840768 00000100:00100000:0.0:1787583077.327170:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435840768 00000100:00100000:0.0:1787583077.327184:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787583077.327193:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435840512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.327299:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435841024 00000100:00100000:1.0:1787583077.327302:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435841024 00000100:00100000:1.0:1787583077.327330:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435841536 00000100:00100000:1.0:1787583077.327333:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435841536 00000100:00100000:1.0:1787583077.327353:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787583077.327359:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435841024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583077.333543:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583077.333619:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435840640:0@lo:400:kworker.0 00000100:00100000:2.0:1787583077.333675:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583077.333709:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435841152:0@lo:400:kworker.0 00000100:00100000:2.0:1787583077.333732:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583077.333743:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435841664:0@lo:400:kworker.0 00000100:00100000:2.0:1787583077.334110:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583077.334195:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787583077.334204:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247c9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435841792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583077.334233:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583077.334311:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435841152 00000100:00100000:2.0:1787583077.334318:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435841152 00000100:00100000:2.0:1787583077.334355:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435841664 00000100:00100000:2.0:1787583077.334359:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435841664 00000100:00100000:2.0:1787583077.334379:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787583077.334388:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435841536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583077.334439:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435841536:12345-0@lo:400:kworker.0 Request processed in 52us (7828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583077.334457:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787583077.334475:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787583077.334482:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435841152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583077.334515:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435841152:12345-0@lo:400:kworker.0 Request processed in 34us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583077.334521:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787583077.334533:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787583077.334539:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435841664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583077.334566:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435841664:12345-0@lo:400:kworker.0 Request processed in 27us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583077.334572:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787583077.334596:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787583077.334604:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435840896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583077.334639:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435840896:12345-0@lo:400:kworker.0 Request processed in 36us (7912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583077.334645:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787583077.334661:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787583077.334668:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435841408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583077.334835:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435840128 00000100:00100000:0.0:1787583077.334841:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435840128 00000100:00100000:0.0:1787583077.334909:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1787583077.334916:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435840128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583077.338647:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583077.338777:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435840128:12345-0@lo:400:kworker.0 Request processed in 3858us (5238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583077.338792:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787583077.341629:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435841024:12345-0@lo:400:kworker.0 Request processed in 14262us (15067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583077.341643:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787583077.341707:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435841792 00000100:00100000:1.0:1787583077.341716:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435841792 00000100:00100000:1.0:1787583077.341763:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787583077.341772:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435841792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787583077.341800:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583077.341930:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435841792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (7695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583077.341937:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1787583077.341981:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924667ea00 x1874416435840896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583077.342018:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435840896:0@lo:400:kworker.0 00010000:00080000:1.0:1787583077.342101:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15dc00 x1874416435841408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583077.342112:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435841408:0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.342127:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435841024:0@lo:400:kworker.0 00010000:00080000:1.0:1787583077.342138:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15ea00 x1874416435841536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583077.342146:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435841536:0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.342176:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787583077.342191:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435841920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583077.342230:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583077.342394:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435840384 00000100:00100000:1.0:1787583077.342399:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435840384 00000100:00100000:1.0:1787583077.342420:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435840640 00000100:00100000:1.0:1787583077.342423:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435840640 00000100:00100000:1.0:1787583077.342434:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435841920 00000100:00100000:1.0:1787583077.342437:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435841920 00000100:00100000:1.0:1787583077.342449:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787583077.342455:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435840384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.342498:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435840384:12345-0@lo:400:kworker.0 Request processed in 43us (15824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583077.342505:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787583077.342517:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787583077.342522:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435840640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.342561:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435840640:12345-0@lo:400:kworker.0 Request processed in 38us (8885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583077.342567:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787583077.342579:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787583077.342585:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435841920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787583077.342605:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787583077.342640:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435841920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583077.342646:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787583077.342676:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435841920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583077.342686:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435840384:0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.342764:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435840512:12345-0@lo:400:kworker.0 Request processed in 15571us (16301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583077.342773:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787583077.342800:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435840512:0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.342909:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435841280 00000100:00100000:1.0:1787583077.342914:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435841280 00000100:00100000:1.0:1787583077.342937:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787583077.342943:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435840256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583077.342975:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435840256:12345-0@lo:400:kworker.0 Request processed in 33us (16067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583077.342982:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787583077.342994:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787583077.343001:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435840768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583077.343036:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435841408:12345-0@lo:400:kworker.0 Request processed in 8364us (16272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583077.343046:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787583077.343064:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787583077.343072:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435841280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583077.343105:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435841280:12345-0@lo:400:kworker.0 Request processed in 35us (4468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583077.343118:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787583077.343133:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435840768:12345-0@lo:400:kworker.0 Request processed in 130us (16179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583077.343141:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00080000:2.0:1787583077.343181:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247c9e680 x1874416435841792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583077.343196:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247c9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435841792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583077.343208:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435840128:0@lo:400:kworker.0 00000100:00100000:2.0:1787583077.343219:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435840640:0@lo:400:kworker.0 00000100:00080000:1.0:1787583077.343222:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787583077.343229:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583077.343231:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000100:00080000:1.0:1787583077.343232:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1787583077.343239:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff909245ae7800, transno 4294967301 00000100:00100000:2.0:1787583077.343251:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435841152:0@lo:400:kworker.0 00010000:00080000:2.0:1787583077.343263:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f15c700 x1874416435841664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583077.343271:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435841664:0@lo:400:kworker.0 00000100:00100000:3.0:1787583077.343711:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435841280:0@lo:400:kworker.0 00000100:00100000:3.0:1787583077.343732:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435840256:0@lo:400:kworker.0 00000100:00100000:3.0:1787583077.343742:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435840768:0@lo:400:kworker.0 00010000:00010000:0.0:1787583077.774024:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583077.839055:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787583077.839078:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435842048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787583077.839154:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583077.839370:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435842048 00000100:00100000:0.0:1787583077.839378:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435842048 00000100:00100000:0.0:1787583077.839429:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787583077.839439:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435842048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787583077.839461:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787583077.839524:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435842048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583077.839532:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1787583077.839578:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909352be9c00 x1874416435842048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583077.839599:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435842048:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787583078.799355:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583079.828418:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583080.206069:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583080.206117:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583080.206148:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583080.206184:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583080.206205:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583080.206228:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583080.206295:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413733248 00000100:00100000:3.0:1787583080.206306:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413733248 00000100:00100000:2.0:1787583080.206306:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413733120 00000100:00100000:2.0:1787583080.206314:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413733120 00000100:00100000:2.0:1787583080.206366:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 369 00000100:00100000:3.0:1787583080.206367:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413733376 00000100:00100000:3.0:1787583080.206373:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413733376 00000100:00100000:2.0:1787583080.206378:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:2405:x1874416413733120:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583080.206390:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413733632 00000100:00100000:3.0:1787583080.206395:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413733632 00000100:00100000:3.0:1787583080.206421:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413733760 00000100:00100000:3.0:1787583080.206425:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413733760 00000100:00100000:3.0:1787583080.206445:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 230 00000100:00100000:2.0:1787583080.206448:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:2405:x1874416413733120:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 71us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583080.206457:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413733248:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583080.206462:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 369 00000100:00100000:2.0:1787583080.206503:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413733504 00000100:00100000:3.0:1787583080.206504:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413733248:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 49us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583080.206508:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413733504 00000100:00100000:3.0:1787583080.206517:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 230 00000100:00100000:3.0:1787583080.206537:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 231 00000100:00100000:3.0:1787583080.206544:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413733376:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583080.206557:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:3.0:1787583080.206574:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413733376:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583080.206586:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 231 00000100:00100000:2.0:1787583080.206587:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413733504:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583080.206607:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:3.0:1787583080.206616:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2405:x1874416413733632:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583080.206623:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413733504:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 41us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583080.206630:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:3.0:1787583080.206652:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2405:x1874416413733632:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583080.206667:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:3.0:1787583080.206702:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:3.0:1787583080.206710:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2404:x1874416413733760:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583080.206745:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2404:x1874416413733760:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583080.206752:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00080000:0.0:1787583080.210278:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787583080.210288:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787583080.210291:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787583080.399490:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787583080.399516:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435842176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787583080.399596:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583080.399758:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435842176 00000100:00100000:1.0:1787583080.399766:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435842176 00000100:00100000:1.0:1787583080.399820:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787583080.399830:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435842176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787583080.399897:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787583080.399963:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435842176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583080.399970:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787583080.400107:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435842176:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787583080.848474:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583081.422314:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583081.422339:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435842304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787583081.422438:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583081.422655:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435842304 00000100:00100000:1.0:1787583081.422673:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435842304 00000100:00100000:1.0:1787583081.422744:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787583081.422755:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435842304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787583081.422783:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583081.422835:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435842304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583081.422842:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787583081.422914:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435842304:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787583081.423371:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583081.423797:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435842432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583081.423875:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583081.424326:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435842432 00000100:00100000:1.0:1787583081.424334:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435842432 00000100:00100000:1.0:1787583081.424407:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787583081.424433:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435842432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787583081.424452:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583081.424496:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435842432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583081.424503:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1787583081.424623:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583081.425111:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435842432:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787583081.870563:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583082.447534:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435842944:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.447607:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.447675:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435843456:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.447702:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.447719:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435843968:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.447739:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.447767:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787583082.447773:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435842560:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.447801:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.447822:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435843072:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.447842:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.447881:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435843584:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.447920:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.447937:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435844096:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.447957:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.447984:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435842816:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.448008:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.448025:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435843328:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.448044:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.448059:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435843840:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.448075:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.448092:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787583082.448110:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435842688:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.448300:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.448322:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435843200:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.448345:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.448356:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435843712:0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.448375:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.448399:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435842944 00000100:00100000:3.0:1787583082.448407:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435842944 00000100:00100000:3.0:1787583082.448444:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435843328 00000100:00100000:3.0:1787583082.448448:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435843328 00000100:00100000:3.0:1787583082.448467:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435843840 00000100:00100000:3.0:1787583082.448470:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435843840 00000100:00100000:3.0:1787583082.448482:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435842688 00000100:00100000:3.0:1787583082.448485:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435842688 00000100:00100000:3.0:1787583082.448495:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435843200 00000100:00100000:3.0:1787583082.448497:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435843200 00000100:00100000:3.0:1787583082.448509:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435843712 00000100:00100000:3.0:1787583082.448517:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435843712 00000100:00100000:3.0:1787583082.448538:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787583082.448546:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435842944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.448600:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435842944:12345-0@lo:400:kworker.0 Request processed in 54us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583082.448607:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787583082.448625:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787583082.448631:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435843328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.448673:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435843328:12345-0@lo:400:kworker.0 Request processed in 43us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583082.448678:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787583082.448690:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787583082.448696:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435843840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.448723:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435843840:12345-0@lo:400:kworker.0 Request processed in 28us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583082.448729:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787583082.448742:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787583082.448749:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435842688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.448780:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435842688:12345-0@lo:400:kworker.0 Request processed in 31us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583082.448787:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787583082.448792:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435844224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583082.448801:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787583082.448808:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435843200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583082.448835:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583082.448865:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435843200:12345-0@lo:400:kworker.0 Request processed in 36us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583082.448882:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787583082.448901:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435843456 00000100:00100000:3.0:1787583082.448902:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787583082.448911:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435843712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583082.448912:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435843456 00000100:00100000:1.0:1787583082.448944:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435843968 00000100:00100000:1.0:1787583082.448948:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435843968 00000100:00100000:3.0:1787583082.448951:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435843712:12345-0@lo:400:kworker.0 Request processed in 39us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583082.448959:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787583082.448964:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435843584 00000100:00100000:1.0:1787583082.448969:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435843584 00000100:00100000:3.0:1787583082.448984:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435842560 00000100:00100000:1.0:1787583082.448986:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435844096 00000100:00100000:3.0:1787583082.448990:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435842560 00000100:00100000:1.0:1787583082.448991:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435844096 00000100:00100000:1.0:1787583082.449017:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787583082.449027:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787583082.449028:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435843456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583082.449039:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435842560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583082.449071:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435843456:12345-0@lo:400:kworker.0 Request processed in 46us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583082.449079:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787583082.449083:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435842560:12345-0@lo:400:kworker.0 Request processed in 46us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583082.449091:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787583082.449097:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787583082.449104:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435843968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583082.449135:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435843968:12345-0@lo:400:kworker.0 Request processed in 31us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583082.449141:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787583082.449151:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787583082.449157:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435843584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583082.449195:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435843584:12345-0@lo:400:kworker.0 Request processed in 38us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583082.449201:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787583082.449211:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787583082.449217:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435844096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583082.449247:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435844096:12345-0@lo:400:kworker.0 Request processed in 31us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583082.449253:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787583082.449278:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435844224 00000100:00100000:1.0:1787583082.449282:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435844224 00000100:00100000:0.0:1787583082.449302:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435843072 00000100:00100000:0.0:1787583082.449308:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435843072 00000100:00100000:0.0:1787583082.449333:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435842816 00000100:00100000:0.0:1787583082.449336:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435842816 00000100:00100000:0.0:1787583082.449350:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787583082.449357:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435843072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583082.449392:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435843072:12345-0@lo:400:kworker.0 Request processed in 36us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583082.449398:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787583082.449410:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787583082.449415:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435842816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583082.449442:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435842816:12345-0@lo:400:kworker.0 Request processed in 27us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583082.449448:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787583082.449497:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787583082.449505:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435844224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787583082.449538:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435842560:0@lo:400:kworker.0 00000100:00100000:0.0:1787583082.449551:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435843072:0@lo:400:kworker.0 00000100:00100000:0.0:1787583082.449561:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435843584:0@lo:400:kworker.0 00010000:00080000:0.0:1787583082.449571:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909352bea680 x1874416435844096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583082.449581:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435844096:0@lo:400:kworker.0 00000100:00100000:0.0:1787583082.449592:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435842944:0@lo:400:kworker.0 00002000:00000024:1.0:1787583082.449596:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787583082.449618:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435843456:0@lo:400:kworker.0 00010000:00080000:0.0:1787583082.449632:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909352be8700 x1874416435843968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583082.449644:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435844224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583082.449644:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435843968:0@lo:400:kworker.0 00000100:00100000:1.0:1787583082.449669:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1787583082.449705:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924667ea00 x1874416435844224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583082.449721:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435844224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787583082.449763:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435842688:0@lo:400:kworker.0 00000100:00100000:1.0:1787583082.449774:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435843200:0@lo:400:kworker.0 00000100:00100000:1.0:1787583082.449784:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435843712:0@lo:400:kworker.0 00000100:00100000:1.0:1787583082.449794:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435842816:0@lo:400:kworker.0 00010000:00080000:1.0:1787583082.449820:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909352bebb80 x1874416435843328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583082.449830:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435843328:0@lo:400:kworker.0 00010000:00080000:1.0:1787583082.449842:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909352be9180 x1874416435843840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583082.449875:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435843840:0@lo:400:kworker.0 00000100:00080000:2.0:1787583082.450090:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787583082.450096:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583082.450098:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787583082.450270:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787583082.450282:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435844352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583082.450313:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583082.450378:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435844352 00000100:00100000:0.0:1787583082.450383:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435844352 00000100:00100000:0.0:1787583082.450416:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787583082.450424:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435844352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787583082.450446:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787583082.450488:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435844352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583082.450493:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787583082.450589:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435844352:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787583082.894302:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583082.958292:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787583082.958317:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435844480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787583082.958388:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583082.958511:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435844480 00000100:00100000:1.0:1787583082.958535:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435844480 00000100:00100000:1.0:1787583082.958583:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787583082.958593:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435844480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787583082.958613:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583082.958671:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435844480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583082.958688:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1787583082.958818:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909352bebb80 x1874416435844480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583082.958838:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435844480:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1787583083.342874:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787583083.345426:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787583083.919608:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583084.942068:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583085.328573:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583085.328682:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583085.328731:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583085.329083:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413734144 00000100:00100000:3.0:1787583085.329092:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413734144 00000100:00100000:3.0:1787583085.329154:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413734016 00000100:00100000:3.0:1787583085.329156:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413734016 00000100:00100000:3.0:1787583085.329241:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00100000:3.0:1787583085.329251:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413734144:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583085.329317:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413734144:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583085.329324:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00100000:3.0:1787583085.329338:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:3.0:1787583085.329344:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413734016:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583085.329511:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413734016:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 19us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583085.329519:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00080000:2.0:1787583085.329709:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583085.329713:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787583085.330822:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413733888 00000100:00100000:0.0:1787583085.330834:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413733888 00000100:00100000:0.0:1787583085.330910:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 371 00000100:00100000:0.0:1787583085.330929:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2407:x1874416413733888:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583085.331277:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2407:x1874416413733888:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 357us (2712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583085.331285:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 371 00000100:00100000:2.0:1787583085.360080:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583085.360127:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583085.360163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583085.360247:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413734272 00000100:00100000:1.0:1787583085.360257:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413734272 00000100:00100000:1.0:1787583085.360327:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1787583085.360338:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2403:x1874416413734272:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:1.0:1787583085.360365:0:8445:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6390 00000100:00080000:1.0:1787583085.360374:0:8445:0:(import.c:65:import_set_state_nolock()) ffff90937fc06800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787583085.360418:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1787583085.360575:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+2:2403:x1874416413734272:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 237us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583085.360582:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00010000:00010000:1.0:1787583085.360616:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583085.360795:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413734528 00000100:00100000:3.0:1787583085.360800:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413734528 00000100:00100000:3.0:1787583085.360841:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413734400 00000100:00100000:3.0:1787583085.360877:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413734400 00000100:00100000:3.0:1787583085.360907:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:3.0:1787583085.360915:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413734528:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583085.360952:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413734528:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583085.360959:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:3.0:1787583085.360973:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:3.0:1787583085.360979:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413734400:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583085.361015:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413734400:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583085.361021:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00080000:2.0:1787583085.363107:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583085.363115:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583085.363118:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583085.518402:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435844608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787583085.518479:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583085.519051:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435844608 00000100:00100000:2.0:1787583085.519060:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435844608 00000100:00100000:2.0:1787583085.519135:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787583085.519145:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435844608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787583085.519178:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787583085.526088:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435844608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6934us (7599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583085.526104:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787583085.527179:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435844608:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787583085.966120:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583086.542165:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435844736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583086.542239:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583086.542485:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787583086.542493:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435844864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583086.542525:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583086.542614:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435844736 00000100:00100000:2.0:1787583086.542621:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435844736 00000100:00100000:2.0:1787583086.542681:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435844864 00000100:00100000:2.0:1787583086.542684:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435844864 00000100:00100000:2.0:1787583086.542701:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787583086.542709:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435844736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583086.542747:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583086.542789:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435844736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583086.542796:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787583086.542813:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787583086.542819:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435844864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787583086.542827:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583086.542861:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435844864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583086.542867:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787583086.543035:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583086.543069:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435844864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583086.543080:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435844736:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787583086.990186:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583087.566880:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787583087.566906:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435844992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583087.566974:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583087.567028:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435844992 00000100:00100000:1.0:1787583087.567037:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435844992 00000100:00080000:3.0:1787583087.567072:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787583087.567091:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787583087.567102:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435844992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787583087.567141:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583087.567197:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435844992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583087.567204:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787583087.567651:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787583087.567686:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435845120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787583087.567747:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583087.568874:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435845120 00000100:00100000:2.0:1787583087.568883:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435845120 00000100:00100000:2.0:1787583087.568938:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787583087.568950:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435845120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787583087.568984:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787583087.569044:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435845120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583087.569051:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787583087.569069:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435845376:0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.569088:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435845248:0@lo:400:kworker.0 00000100:00100000:0.0:1787583087.569122:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583087.569128:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583087.569187:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435845888:0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.569191:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435845760:0@lo:400:kworker.0 00000100:00100000:0.0:1787583087.569222:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583087.569238:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435845248 00000100:00100000:2.0:1787583087.569243:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435845248 00000100:00100000:0.0:1787583087.569250:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435846400:0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.569274:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787583087.569280:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583087.569287:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435845248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583087.569322:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435845376 00000100:00100000:0.0:1787583087.569327:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435845376 00000100:00100000:2.0:1787583087.569329:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435845248:12345-0@lo:400:kworker.0 Request processed in 44us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583087.569338:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787583087.569359:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435845888 00000100:00100000:0.0:1787583087.569363:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435845888 00000100:00100000:0.0:1787583087.569385:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787583087.569393:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435845376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.569399:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435845504:0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.569435:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583087.569443:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435845376:12345-0@lo:400:kworker.0 Request processed in 50us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583087.569451:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787583087.569459:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435846016:0@lo:400:kworker.0 00000100:00100000:0.0:1787583087.569465:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435846400 00000100:00100000:0.0:1787583087.569470:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435846400 00000100:00100000:2.0:1787583087.569484:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583087.569493:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787583087.569502:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435845888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.569506:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435846528:0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.569541:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583087.569547:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435845888:12345-0@lo:400:kworker.0 Request processed in 45us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583087.569555:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787583087.569569:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787583087.569576:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435846400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.569585:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435845120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583087.569608:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787583087.569614:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435845632:0@lo:400:kworker.0 00000100:00100000:0.0:1787583087.569642:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435846400:12345-0@lo:400:kworker.0 Request processed in 65us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583087.569653:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583087.569654:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787583087.569670:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435846144:0@lo:400:kworker.0 00000100:00100000:0.0:1787583087.569684:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435845632 00000100:00100000:2.0:1787583087.569692:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583087.569715:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435845504 00000100:00100000:2.0:1787583087.569719:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435845504 00000100:00100000:2.0:1787583087.569737:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787583087.569742:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435845504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.569772:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435845504:12345-0@lo:400:kworker.0 Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583087.569787:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787583087.569821:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435845504:0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.569841:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583087.569878:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435846272:0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.569901:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583087.569923:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435845248:0@lo:400:kworker.0 00000100:00100000:1.0:1787583087.569936:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435846016 00000100:00100000:1.0:1787583087.569942:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435846016 00000100:00100000:2.0:1787583087.569968:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435845760 00000100:00100000:2.0:1787583087.569973:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435845760 00000100:00100000:1.0:1787583087.569975:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435846528 00000100:00100000:1.0:1787583087.569980:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435846528 00000100:00100000:2.0:1787583087.569998:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435846272 00000100:00100000:2.0:1787583087.570003:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435846272 00000100:00100000:1.0:1787583087.570005:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435846144 00000100:00100000:1.0:1787583087.570011:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435846144 00000100:00100000:2.0:1787583087.570027:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787583087.570035:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787583087.570039:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435845760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583087.570048:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352bea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435846016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.570085:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435845760:12345-0@lo:400:kworker.0 Request processed in 49us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583087.570092:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787583087.570108:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787583087.570115:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435846272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583087.570119:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352bea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435846016:12345-0@lo:400:kworker.0 Request processed in 62us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583087.570128:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787583087.570146:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787583087.570151:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435846272:12345-0@lo:400:kworker.0 Request processed in 37us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583087.570158:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435846528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.570164:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787583087.570192:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787583087.570197:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435846528:12345-0@lo:400:kworker.0 Request processed in 42us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583087.570205:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435846144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583087.570208:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787583087.570251:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435846144:12345-0@lo:400:kworker.0 Request processed in 49us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583087.570256:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435846144:0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.570262:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787583087.570273:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435846016:0@lo:400:kworker.0 00010000:00080000:1.0:1787583087.570299:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c4380 x1874416435846528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583087.570311:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435846528:0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.570316:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435845376:0@lo:400:kworker.0 00010000:00080000:2.0:1787583087.570333:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c7480 x1874416435845888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583087.570343:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435845888:0@lo:400:kworker.0 00010000:00080000:2.0:1787583087.570356:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c4700 x1874416435846400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583087.570365:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435846400:0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.570394:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435845760:0@lo:400:kworker.0 00000100:00100000:2.0:1787583087.570402:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435846272:0@lo:400:kworker.0 00000100:00080000:3.0:1787583087.570572:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787583087.570577:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787583087.570579:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787583087.570602:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924764a300 x1874416435844992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583087.570669:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435844992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787583087.570809:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435845632 00000100:00100000:0.0:1787583087.570872:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787583087.570879:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435845632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583087.570919:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435845632:12345-0@lo:400:kworker.0 Request processed in 41us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583087.570925:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787583087.572177:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435845632:0@lo:400:kworker.0 00010000:00010000:1.0:1787583088.015951:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583088.078302:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435846656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787583088.078376:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583088.078500:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435846656 00000100:00100000:1.0:1787583088.078509:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435846656 00000100:00100000:1.0:1787583088.078568:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787583088.078578:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435846656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787583088.078600:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583088.091392:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435846656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 12806us (13006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583088.091407:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1787583088.092174:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909352be9880 x1874416435846656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583088.092221:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435846656:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787583089.038130:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583090.062110:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583090.450518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583090.450716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583090.451936:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413734656 00000100:00100000:3.0:1787583090.451948:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413734656 00000100:00100000:3.0:1787583090.452004:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 373 00000100:00100000:3.0:1787583090.452014:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093736b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413734656:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583090.453262:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093736b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413734656:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1240us (2536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583090.453275:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 373 00000100:00100000:0.0:1787583090.454828:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413734784 00000100:00100000:0.0:1787583090.454840:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413734784 00000100:00080000:3.0:1787583090.456956:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787583090.458223:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:0.0:1787583090.458242:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413734784:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583090.458408:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583090.458441:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583090.458473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583090.458494:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413735040 00000100:00100000:1.0:1787583090.458501:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413735040 00000100:00100000:3.0:1787583090.458514:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413734912 00000100:00100000:3.0:1787583090.458521:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413734912 00000100:00100000:1.0:1787583090.458542:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413735168 00000100:00100000:1.0:1787583090.458547:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413735168 00000100:00100000:3.0:1787583090.458556:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:3.0:1787583090.458567:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413735040:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583090.458573:0:6528:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787583090.458582:0:6528:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:1.0:1787583090.458611:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787583090.458615:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787583090.458628:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413735040:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 64us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583090.458637:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:3.0:1787583090.458656:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:3.0:1787583090.458664:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413734912:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583090.458694:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413734912:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583090.458701:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:3.0:1787583090.458715:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 253 00000100:00100000:3.0:1787583090.458724:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413735168:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583090.458771:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413735168:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 48us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583090.458778:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 253 00000100:00100000:0.0:1787583090.462735:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413734784:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 4489us (12213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583090.462751:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:2.0:1787583090.638440:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435846784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787583090.638498:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583090.638611:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435846784 00000100:00100000:3.0:1787583090.638620:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435846784 00000100:00100000:3.0:1787583090.638712:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787583090.638722:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435846784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787583090.638753:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787583090.638811:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435846784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583090.638818:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787583090.638867:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435846784:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1787583090.641204:0:8437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000020:00000080:0.0:1787583090.641210:0:8437:0:(genops.c:885:class_export_put()) final put ffff90937fc03800/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000020:00000080:1.0:1787583090.641259:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90937fc03800/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae for lustre-OST0000 00000020:00000080:1.0:1787583090.641523:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90937fc06800 for lustre-OST0000 00010000:00010000:3.0:1787583091.086050:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583091.666221:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435846912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787583091.666303:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583091.666547:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435846912 00000100:00100000:3.0:1787583091.666556:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435846912 00000100:00100000:3.0:1787583091.666633:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787583091.666646:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435846912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787583091.666676:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787583091.666987:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583091.667135:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435847040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583091.667173:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583091.667210:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435847040 00000100:00100000:1.0:1787583091.667214:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435847040 00000100:00100000:1.0:1787583091.667244:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787583091.667251:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435847040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787583091.667265:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583091.667308:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435847040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583091.667315:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787583091.667361:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435847040:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787583091.667757:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583091.667982:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435846912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1338us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583091.667992:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787583091.668083:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435846912:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787583092.111930:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583092.686067:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435847552:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686134:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686184:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435848064:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686209:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686225:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435848576:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686245:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686273:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787583092.686279:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435847168:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686306:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686342:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435847680:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686365:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686382:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435848192:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686414:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686429:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435848704:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686452:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686478:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435847296:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686500:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686520:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435847808:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686539:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686555:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435848320:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686577:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686608:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787583092.686614:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435847424:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686635:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686650:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435847936:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686667:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686683:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435848448:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686702:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.686729:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435847552 00000100:00100000:1.0:1787583092.686735:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435847552 00000100:00100000:1.0:1787583092.686772:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435847296 00000100:00100000:1.0:1787583092.686776:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435847296 00000100:00100000:1.0:1787583092.686801:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435847808 00000100:00100000:1.0:1787583092.686804:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435847808 00000100:00100000:1.0:1787583092.686823:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435848320 00000100:00100000:1.0:1787583092.686826:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435848320 00000100:00100000:1.0:1787583092.686838:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435847936 00000100:00100000:1.0:1787583092.686841:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435847936 00000100:00100000:1.0:1787583092.686876:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435848448 00000100:00100000:1.0:1787583092.686886:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435848448 00000100:00100000:1.0:1787583092.686906:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787583092.686914:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435847552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.686979:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435847552:12345-0@lo:400:kworker.0 Request processed in 52us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.686986:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787583092.687004:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787583092.687010:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435847296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687041:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435847296:12345-0@lo:400:kworker.0 Request processed in 31us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.687046:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787583092.687058:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787583092.687064:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435847808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687091:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435847808:12345-0@lo:400:kworker.0 Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.687097:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787583092.687108:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787583092.687114:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435848320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687139:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435848320:12345-0@lo:400:kworker.0 Request processed in 26us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.687145:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787583092.687157:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787583092.687163:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435847936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687190:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435847936:12345-0@lo:400:kworker.0 Request processed in 26us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.687205:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787583092.687217:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787583092.687223:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435848448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687251:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435848448:12345-0@lo:400:kworker.0 Request processed in 28us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.687257:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787583092.687275:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435848064 00000100:00100000:1.0:1787583092.687278:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435848064 00000100:00100000:1.0:1787583092.687294:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435848576 00000100:00100000:1.0:1787583092.687297:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435848576 00000100:00100000:1.0:1787583092.687307:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435848192 00000100:00100000:1.0:1787583092.687310:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435848192 00000100:00100000:1.0:1787583092.687320:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435848704 00000100:00100000:1.0:1787583092.687323:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435848704 00000100:00100000:1.0:1787583092.687336:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787583092.687343:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435848064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687372:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435848064:12345-0@lo:400:kworker.0 Request processed in 30us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.687378:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787583092.687389:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787583092.687395:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435848576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687421:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435848576:12345-0@lo:400:kworker.0 Request processed in 26us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.687426:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787583092.687437:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787583092.687443:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435848192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687480:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435848192:12345-0@lo:400:kworker.0 Request processed in 38us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.687486:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787583092.687497:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787583092.687503:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435848704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687545:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435848704:12345-0@lo:400:kworker.0 Request processed in 42us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.687551:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787583092.687573:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435847680 00000100:00100000:1.0:1787583092.687576:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435847680 00000100:00100000:1.0:1787583092.687611:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435847424 00000100:00100000:1.0:1787583092.687614:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435847424 00000100:00100000:1.0:1787583092.687626:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787583092.687631:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435847680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687663:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435847680:12345-0@lo:400:kworker.0 Request processed in 32us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.687668:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787583092.687678:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787583092.687683:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435847424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687709:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435847424:12345-0@lo:400:kworker.0 Request processed in 26us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.687714:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787583092.687767:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435847424:0@lo:400:kworker.0 00010000:00080000:1.0:1787583092.687781:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245893100 x1874416435847936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583092.687803:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435847936:0@lo:400:kworker.0 00010000:00080000:1.0:1787583092.687815:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b60000 x1874416435848448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583092.687822:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435848448:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687832:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435847296:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687841:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435847808:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687874:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435848320:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687912:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435847680:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687922:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435848192:0@lo:400:kworker.0 00010000:00080000:1.0:1787583092.687932:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b60e00 x1874416435848704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583092.687940:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435848704:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687951:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435847552:0@lo:400:kworker.0 00000100:00100000:1.0:1787583092.687960:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435848064:0@lo:400:kworker.0 00010000:00080000:1.0:1787583092.687968:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b63b80 x1874416435848576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583092.687976:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435848576:0@lo:400:kworker.0 00000100:00100000:2.0:1787583092.694836:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435847168 00000100:00100000:2.0:1787583092.694866:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435847168 00000100:00100000:2.0:1787583092.694924:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1787583092.694935:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435847168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583092.695027:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435847168:12345-0@lo:400:kworker.0 Request processed in 94us (8719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583092.695034:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00080000:2.0:1787583092.695075:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787583092.695095:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583092.695098:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583092.695149:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583092.695164:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435848832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583092.695200:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583092.695233:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435848832 00000100:00100000:2.0:1787583092.695237:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435848832 00000100:00100000:2.0:1787583092.695263:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787583092.695269:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435848832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787583092.695295:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787583092.695347:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435848832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583092.695354:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787583092.695396:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435848832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583092.695429:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435847168:0@lo:400:kworker.0 00000100:00100000:2.0:1787583092.696555:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435848960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583092.696616:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583092.699594:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435848960 00000100:00100000:1.0:1787583092.699606:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435848960 00000100:00100000:1.0:1787583092.699749:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787583092.699760:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435848960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787583092.699799:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583092.699901:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435848960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (3284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583092.699909:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:2.0:1787583092.704217:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936f2b7480 x1874416435848960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583092.704246:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f2b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435848960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787583093.139147:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583093.201138:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435849088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583093.201204:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583093.201280:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435849088 00000100:00100000:2.0:1787583093.201286:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435849088 00000100:00100000:2.0:1787583093.201328:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787583093.201337:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435849088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583093.201369:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583093.201413:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435849088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583093.201420:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:2.0:1787583093.201462:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924667ea00 x1874416435849088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583093.201482:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435849088:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1787583093.583549:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787583093.584808:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787583094.165151:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583095.182091:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583095.569691:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583095.569730:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583095.569738:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413735296 00000100:00100000:3.0:1787583095.569748:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413735296 00000100:00100000:1.0:1787583095.569766:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583095.569793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583095.569814:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 375 00000100:00100000:1.0:1787583095.569820:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583095.569824:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2407:x1874416413735296:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583095.569839:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413735424 00000100:00100000:1.0:1787583095.569843:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413735424 00000100:00100000:1.0:1787583095.569908:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413735552 00000100:00100000:1.0:1787583095.569912:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413735552 00000100:00100000:1.0:1787583095.569924:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413735680 00000100:00100000:1.0:1787583095.569926:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413735680 00000100:00100000:1.0:1787583095.569938:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413735808 00000100:00100000:1.0:1787583095.569941:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413735808 00000100:00100000:1.0:1787583095.569954:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 260 00000100:00100000:1.0:1787583095.569961:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413735424:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583095.570020:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413735424:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 59us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583095.570028:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 260 00000100:00100000:1.0:1787583095.570046:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 261 00000100:00100000:1.0:1787583095.570054:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413735552:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583095.570079:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413735552:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583095.570103:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 261 00000100:00100000:1.0:1787583095.570117:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 262 00000100:00100000:1.0:1787583095.570123:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f2b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413735680:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583095.570149:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f2b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413735680:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583095.570155:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 262 00000100:00100000:1.0:1787583095.570168:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 263 00000100:00100000:1.0:1787583095.570174:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413735808:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583095.570198:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413735808:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583095.570204:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 263 00000100:00080000:1.0:1787583095.570237:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787583095.570241:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787583095.570382:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2407:x1874416413735296:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 558us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583095.570398:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 375 00000100:00100000:1.0:1787583095.759176:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787583095.759200:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435849216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583095.759270:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583095.759400:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435849216 00000100:00100000:3.0:1787583095.759408:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435849216 00000100:00100000:3.0:1787583095.759461:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787583095.759472:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435849216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787583095.759504:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787583095.759570:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435849216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583095.759577:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787583095.759949:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435849216:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787583096.207471:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583096.783752:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583096.783787:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435849344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787583096.783876:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583096.783969:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435849344 00000100:00100000:0.0:1787583096.783993:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435849344 00000100:00100000:0.0:1787583096.784068:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787583096.784079:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435849344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583096.784111:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787583096.784164:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435849344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583096.784171:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787583096.784196:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583096.784205:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435849472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787583096.784232:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787583096.784408:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787583096.784454:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435849344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787583096.784569:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435849472 00000100:00100000:0.0:1787583096.784574:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435849472 00000100:00100000:0.0:1787583096.784613:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787583096.784621:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435849472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787583096.784631:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787583096.784739:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583096.784776:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435849472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583096.784782:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787583096.784813:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435849472:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787583097.231039:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787583097.301724:0:14071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:51:34 (1787583094) 00000100:00100000:1.0:1787583097.806383:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435849984:0@lo:400:kworker.0 00000100:00100000:1.0:1787583097.806448:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583097.806510:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435850496:0@lo:400:kworker.0 00000100:00100000:1.0:1787583097.806535:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583097.806564:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435851008:0@lo:400:kworker.0 00000100:00100000:1.0:1787583097.806600:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583097.806631:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787583097.806637:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435849856:0@lo:400:kworker.0 00000100:00100000:1.0:1787583097.806660:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583097.806674:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435850368:0@lo:400:kworker.0 00000100:00100000:1.0:1787583097.806692:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583097.806707:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435850880:0@lo:400:kworker.0 00000100:00100000:1.0:1787583097.806727:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583097.806758:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435849984 00000100:00100000:1.0:1787583097.806766:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435849984 00000100:00100000:1.0:1787583097.806810:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435850368 00000100:00100000:1.0:1787583097.806813:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435850368 00000100:00100000:1.0:1787583097.806835:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435850880 00000100:00100000:1.0:1787583097.806838:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435850880 00000100:00100000:1.0:1787583097.806877:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787583097.806886:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435849984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583097.806935:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435849984:12345-0@lo:400:kworker.0 Request processed in 49us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583097.806941:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787583097.806956:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787583097.806961:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435850368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583097.806986:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435850368:12345-0@lo:400:kworker.0 Request processed in 24us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583097.807274:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435849600:0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.807311:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583097.807335:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435850112:0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.807358:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583097.807375:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435850624:0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.807395:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583097.807424:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435851136:0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.807445:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583097.807462:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787583097.807468:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435849728:0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.807488:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583097.807499:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435850240:0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.807519:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583097.807530:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435850752:0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.807560:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583097.807601:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435849728 00000100:00100000:0.0:1787583097.807605:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435849728 00000100:00100000:0.0:1787583097.807625:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435850240 00000100:00100000:0.0:1787583097.807628:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435850240 00000100:00100000:0.0:1787583097.807639:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435850752 00000100:00100000:0.0:1787583097.807642:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435850752 00000100:00100000:0.0:1787583097.807656:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787583097.807662:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435850880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.807697:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435850880:12345-0@lo:400:kworker.0 Request processed in 35us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583097.807703:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787583097.807716:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787583097.807722:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435849728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.807752:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435849728:12345-0@lo:400:kworker.0 Request processed in 31us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583097.807758:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787583097.807771:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787583097.807777:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435850240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.807814:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435850240:12345-0@lo:400:kworker.0 Request processed in 36us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583097.807820:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787583097.807868:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787583097.807876:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435850752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.807905:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435850752:12345-0@lo:400:kworker.0 Request processed in 30us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583097.807911:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787583097.807933:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435850496 00000100:00100000:0.0:1787583097.807936:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435850496 00000100:00100000:0.0:1787583097.807953:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435851008 00000100:00100000:0.0:1787583097.807956:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435851008 00000100:00100000:0.0:1787583097.807967:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435850624 00000100:00100000:0.0:1787583097.807969:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435850624 00000100:00100000:0.0:1787583097.807978:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435851136 00000100:00100000:0.0:1787583097.807981:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435851136 00000100:00100000:0.0:1787583097.808078:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787583097.808086:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435850496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.808118:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435850496:12345-0@lo:400:kworker.0 Request processed in 34us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583097.808276:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787583097.808292:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787583097.808299:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435851008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.808330:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435851008:12345-0@lo:400:kworker.0 Request processed in 32us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583097.808336:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787583097.808348:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787583097.808362:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435850624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.808391:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435850624:12345-0@lo:400:kworker.0 Request processed in 30us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583097.808396:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787583097.808408:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787583097.808414:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435851136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.808439:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435851136:12345-0@lo:400:kworker.0 Request processed in 26us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583097.808445:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787583097.808487:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435849728:0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.808498:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435850240:0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.808505:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435850752:0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.808514:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435850624:0@lo:400:kworker.0 00010000:00080000:0.0:1787583097.808525:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909348840700 x1874416435851136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583097.808536:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435851136:0@lo:400:kworker.0 00010000:00080000:0.0:1787583097.808606:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245890000 x1874416435850368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583097.808616:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435850368:0@lo:400:kworker.0 00010000:00080000:0.0:1787583097.808626:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90936d838a80 x1874416435850880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583097.808634:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435850880:0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.808655:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435849984:0@lo:400:kworker.0 00000100:00100000:0.0:1787583097.808665:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435850496:0@lo:400:kworker.0 00010000:00080000:0.0:1787583097.808674:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909348841180 x1874416435851008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583097.808680:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435851008:0@lo:400:kworker.0 00000100:00100000:3.0:1787583097.808813:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435849856 00000100:00100000:3.0:1787583097.808818:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435849856 00000100:00100000:3.0:1787583097.808868:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435850112 00000100:00100000:3.0:1787583097.808871:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435850112 00000100:00100000:3.0:1787583097.808883:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787583097.808890:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435849856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583097.808929:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435849856:12345-0@lo:400:kworker.0 Request processed in 40us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583097.808934:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787583097.808947:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787583097.808952:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435850112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583097.808982:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435850112:12345-0@lo:400:kworker.0 Request processed in 29us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583097.808987:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787583097.809024:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435850112:0@lo:400:kworker.0 00000100:00100000:3.0:1787583097.809046:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435849856:0@lo:400:kworker.0 00000100:00100000:1.0:1787583097.809393:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1787583097.809520:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787583097.809526:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583097.809528:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787583097.809553:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435849600 00000100:00100000:2.0:1787583097.809557:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435849600 00000100:00100000:2.0:1787583097.809590:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787583097.809597:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435849600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583097.809646:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435849600:12345-0@lo:400:kworker.0 Request processed in 50us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583097.809652:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787583097.809705:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435849600:0@lo:400:kworker.0 00000100:00100000:2.0:1787583097.811278:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435851264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583097.811341:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583097.813950:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583097.813974:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435851392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583097.814049:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583097.814285:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435851392 00000100:00100000:3.0:1787583097.814293:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435851392 00000100:00100000:3.0:1787583097.814343:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787583097.814352:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435851392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787583097.814381:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787583097.814427:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435851392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583097.814434:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787583097.814505:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435851264 00000100:00100000:1.0:1787583097.814510:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435851264 00000100:00100000:1.0:1787583097.814556:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787583097.814579:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924764a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435851264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787583097.814598:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583097.814639:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924764a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435851264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (3298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583097.814645:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:1.0:1787583097.814684:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909348840380 x1874416435851264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583097.814703:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435851264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583097.815280:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435851392:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787583098.254090:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583098.318147:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435851520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787583098.318222:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583098.318373:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435851520 00000100:00100000:1.0:1787583098.318381:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435851520 00000100:00100000:1.0:1787583098.318437:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787583098.318447:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435851520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787583098.318469:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583098.318526:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435851520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583098.318532:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1787583098.318624:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247648700 x1874416435851520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583098.318643:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435851520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583099.019934:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583099.020018:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413735936 00000100:00100000:0.0:1787583099.020028:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413735936 00000100:00100000:0.0:1787583099.020105:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1787583099.020116:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:11093:x1874416413735936:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787583099.020135:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583099.020156:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6470 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4176 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.020220:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6477 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.020232:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.020245:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583099.020306:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787583099.020310:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583099.020368:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.020390:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4176 expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.020407:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4176 expref: 6 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.020416:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e015800) 00010000:00010000:0.0:1787583099.020419:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583099.020423:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e400, rc 0) 00000100:00100000:0.0:1787583099.020486:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:11093:x1874416413735936:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 373us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583099.020493:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00080000:2.0:1787583099.020641:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583099.032148:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583099.032240:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413736064 00000100:00100000:0.0:1787583099.032249:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413736064 00000100:00100000:0.0:1787583099.032311:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1787583099.032323:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:11094:x1874416413736064:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787583099.032344:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583099.032364:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b647e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c417d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032438:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6485 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032451:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032480:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032495:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b648c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032503:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b648c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032509:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b648c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032584:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b6493 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032592:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b6493 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032599:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b6493 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583099.032641:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787583099.032645:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583099.032663:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b6493 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032673:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032679:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6485 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032695:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6485 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032700:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583099.032705:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6485 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032712:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6485 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032723:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e015800) 00010000:00010000:0.0:1787583099.032726:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583099.032731:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6485 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.032738:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6485 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.033264:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b648c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.033584:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b648c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.033592:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b648c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.033597:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583099.033600:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b648c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.033619:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b648c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.033630:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90937e015300) 00010000:00010000:0.0:1787583099.033632:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583099.033635:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b648c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.033641:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b648c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.033679:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b647e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c417d expref: 8 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.033693:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b6493 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c417d expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.033700:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90937e015600) 00010000:00010000:0.0:1787583099.033702:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583099.033704:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713ea00, rc 0) 00000100:00100000:0.0:1787583099.034267:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:11094:x1874416413736064:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1942us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583099.034285:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:1.0:1787583099.046111:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583099.046192:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413736192 00000100:00100000:0.0:1787583099.046201:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413736192 00000100:00100000:0.0:1787583099.046259:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:0.0:1787583099.046269:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:11094:x1874416413736192:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787583099.046384:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:11094:x1874416413736192:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 Request processed in 116us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583099.046392:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1787583099.050437:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583099.054779:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413736448 00000100:00100000:0.0:1787583099.054794:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413736448 00000100:00100000:0.0:1787583099.055157:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:0.0:1787583099.055169:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924667ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:11094:x1874416413736448:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787583099.055190:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583099.055208:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b649a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4184 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.055292:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64a1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.055305:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.055316:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.056723:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b64a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.056740:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b64a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.056750:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b64a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.056907:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b64af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.056930:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b64af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.056937:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b64af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583099.056948:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787583099.057048:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057056:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64a1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057063:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057069:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583099.057072:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057079:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64a1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057090:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90937e015600) 00010000:00010000:0.0:1787583099.057093:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583099.057097:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057102:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057115:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b64a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057129:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b64a8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057135:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b64a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057141:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583099.057144:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b64a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057150:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b64a8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057159:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90937e015300) 00010000:00010000:0.0:1787583099.057161:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583099.057164:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b64a8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057170:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b64a8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057450:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b649a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4184 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057465:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b64af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4184 expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583099.057473:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90937e015500) 00010000:00010000:0.0:1787583099.057475:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583099.057484:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e200, rc 0) 00000100:00100000:0.0:1787583099.057570:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924667ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:11094:x1874416413736448:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 2402us (7141us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787583099.057578:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1787583099.070805:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583099.073709:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413736576 00000100:00100000:1.0:1787583099.073725:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413736576 00000100:00100000:1.0:1787583099.073809:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:1.0:1787583099.073820:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:11094:x1874416413736576:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787583099.074498:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:11094:x1874416413736576:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 679us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583099.074506:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1787583099.076815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583099.076943:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413736704 00000100:00100000:0.0:1787583099.076954:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413736704 00000100:00100000:0.0:1787583099.077018:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:0.0:1787583099.077029:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:11094:x1874416413736704:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1787583099.077164:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787583099.078973:0:6529:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1878us 00000100:00100000:1.0:1787583099.110629:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:11094:x1874416413736704:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 33593us (33815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583099.110650:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00010000:00010000:3.0:1787583099.279057:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787583099.726464:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787583099.727169:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787583100.303036:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583100.687559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583100.689211:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413736832 00000100:00100000:1.0:1787583100.689224:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413736832 00000100:00100000:0.0:1787583100.689242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583100.689286:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 377 00000100:00100000:0.0:1787583100.689287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583100.689300:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2405:x1874416413736832:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583100.689319:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583100.689373:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2405:x1874416413736832:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 76us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583100.689381:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 377 00000100:00100000:3.0:1787583100.689398:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413737088 00000100:00100000:3.0:1787583100.689403:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413737088 00000100:00100000:3.0:1787583100.689441:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413737344 00000100:00100000:3.0:1787583100.689445:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413737344 00000100:00100000:3.0:1787583100.689476:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413736960 00000100:00100000:3.0:1787583100.689479:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413736960 00000100:00100000:3.0:1787583100.689494:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 270 00000100:00100000:3.0:1787583100.689500:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413737088:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583100.689618:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 271 00000100:00100000:1.0:1787583100.689627:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2405:x1874416413737344:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583100.691646:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583100.691772:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413737216 00000100:00100000:0.0:1787583100.691779:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413737216 00000100:00100000:0.0:1787583100.691820:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 272 00000100:00100000:0.0:1787583100.691829:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2405:x1874416413736960:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583100.691909:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2405:x1874416413736960:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 81us (2591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583100.691916:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 272 00000100:00100000:0.0:1787583100.691934:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 273 00000100:00100000:0.0:1787583100.691940:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2405:x1874416413737216:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583100.691963:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2405:x1874416413737216:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583100.691969:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 273 00000100:00100000:3.0:1787583100.692442:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2405:x1874416413737088:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 2939us (3201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583100.692452:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 270 00000100:00080000:3.0:1787583100.692543:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787583100.692547:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787583100.692702:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2405:x1874416413737344:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3074us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583100.692713:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 271 00000100:00100000:2.0:1787583100.883223:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435851648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787583100.883297:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583100.883409:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435851648 00000100:00100000:0.0:1787583100.883417:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435851648 00000100:00100000:0.0:1787583100.883468:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787583100.883478:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435851648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787583100.883511:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787583100.886439:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435851648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2953us (3132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583100.886454:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787583100.886657:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435851648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583101.016515:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.017172:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413737472 00000100:00100000:0.0:1787583101.017183:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413737472 00000100:00100000:0.0:1787583101.017259:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:0.0:1787583101.017270:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:11136:x1874416413737472:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583101.017290:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583101.017319:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b64bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c418b expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017387:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b64c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017400:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b64c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017412:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b64c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017427:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017433:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017452:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017499:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b64c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017506:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b64c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017512:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b64c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017517:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583101.017532:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b64c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017540:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b64c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017552:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e015800) 00010000:00010000:0.0:1787583101.017555:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583101.017559:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b64c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017566:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b64c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017579:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017585:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017595:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017600:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583101.017603:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017608:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017617:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90937e013e00) 00010000:00010000:0.0:1787583101.017619:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583101.017622:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017626:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017654:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b64bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c418b expref: 10 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017663:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e015800) 00010000:00010000:0.0:1787583101.017665:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583101.017668:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b64bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c418b expref: 10 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.017677:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e800, rc 0) 00000100:00100000:0.0:1787583101.017729:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:11136:x1874416413737472:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 461us (1223us total) trans 0 rc 301/301 00000100:00100000:0.0:1787583101.017744:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00080000:3.0:1787583101.018320:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583101.025037:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583101.029485:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413737728 00000100:00100000:3.0:1787583101.029502:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413737728 00000100:00100000:2.0:1787583101.035149:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1787583101.035166:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:11136:x1874416413737728:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:2.0:1787583101.035224:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583101.035252:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b6477 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4176 expref: 9 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.035282:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e015800) 00010000:00010000:2.0:1787583101.035292:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583101.035369:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b64d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.035382:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b64d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.035392:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b64d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.035405:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b64d9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.035412:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b64d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.035420:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b64d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037429:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b64e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037450:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b64e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037461:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b64e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787583101.037481:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000783f8048 reply state 000000006e6b691d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b64e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037506:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b64e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037513:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:2.0:1787583101.037516:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787583101.037529:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787583101.037535:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787583101.037545:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b64d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037552:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b64d2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037558:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b64d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037564:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583101.037568:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b64d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037576:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b64d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037585:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff909345181600) 00010000:00010000:2.0:1787583101.037588:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583101.037591:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b64d2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037597:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b64d2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787583101.037628:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000783f8048 reply state 000000006e6b691d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b64d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037637:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b64d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.037644:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff909345181d00) 00010000:00010000:2.0:1787583101.037646:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787583101.037648:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787583101.037773:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:11136:x1874416413737728:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 2609us (12741us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787583101.037782:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:0.0:1787583101.103765:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.105191:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413737856 00000100:00100000:0.0:1787583101.105205:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413737856 00000100:00100000:0.0:1787583101.105272:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:0.0:1787583101.105283:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:11144:x1874416413737856:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:0.0:1787583101.105308:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583101.105331:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b64e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4192 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.105397:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.105411:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.105422:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583101.105473:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787583101.105478:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583101.105587:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.105612:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b64e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4192 expref: 12 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.105630:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4192 expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.105658:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013e00) 00010000:00010000:0.0:1787583101.105661:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583101.105665:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f600, rc 0) 00000100:00100000:0.0:1787583101.105746:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:11144:x1874416413737856:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 464us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583101.105753:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:3.0:1787583101.157660:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.158093:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413737984 00000100:00100000:0.0:1787583101.158104:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413737984 00000100:00100000:0.0:1787583101.158167:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:0.0:1787583101.158178:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:11150:x1874416413737984:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1787583101.158199:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583101.158217:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b64f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4199 expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158280:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b64fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158292:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b64fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158302:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b64fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158327:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6503 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158335:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6503 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158362:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6503 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158442:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b650a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158450:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b650a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158457:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b650a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583101.158494:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787583101.158497:0:13828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583101.158551:0:13828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b650a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158564:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b64fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158571:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b64fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158578:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b64fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158584:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583101.158588:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b64fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158595:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b64fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158616:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013e00) 00010000:00010000:0.0:1787583101.158619:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583101.158624:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b64fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158630:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b64fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158644:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6503 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158650:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6503 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158655:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6503 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158660:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583101.158663:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6503 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158668:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6503 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158676:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff909345181d00) 00010000:00010000:0.0:1787583101.158678:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583101.158681:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6503 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158688:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6503 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.158725:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b64f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4199 expref: 13 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.159123:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b650a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4199 expref: 12 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.159133:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583101.159135:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787583101.159137:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e400, rc 0) 00000100:00100000:0.0:1787583101.159205:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+12:11150:x1874416413737984:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1029us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583101.159212:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:0.0:1787583101.167804:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583101.168166:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413738240 00000100:00100000:2.0:1787583101.168176:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413738240 00000100:00100000:2.0:1787583101.168234:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1787583101.168245:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+12:11150:x1874416413738240:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1787583101.168265:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583101.168286:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6511 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41a0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.168391:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6518 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.168406:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6518 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.168417:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6518 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.170323:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b651f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.170342:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b651f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.170353:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b651f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787583101.171265:0:6528:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787583101.171452:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6526 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171463:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171471:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171507:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6518 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171514:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6518 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171538:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6518 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171544:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770bc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583101.171549:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6518 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171556:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6518 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171568:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:3.0:1787583101.171572:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583101.171587:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6518 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171593:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6518 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787583101.171607:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005254feba reply state 000000000d8c0860 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b651f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171618:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b651f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171623:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909345181600) 00010000:00010000:3.0:1787583101.171625:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787583101.171628:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787583101.171668:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6511 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a0 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171682:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a0 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.171688:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909351203d00) 00010000:00010000:3.0:1787583101.171691:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787583101.171693:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dede00, rc 0) 00000100:00100000:3.0:1787583101.172353:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:11150:x1874416413738240:12345-192.168.203.11@tcp:101:bash.0 Request processed in 4107us (4555us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787583101.172363:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1787583101.178317:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.178428:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413738368 00000100:00100000:0.0:1787583101.178438:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413738368 00000100:00100000:0.0:1787583101.178556:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:0.0:1787583101.178565:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1874416413738368:12345-192.168.203.11@tcp:8:bash.0 00010000:00080000:0.0:1787583101.178602:0:8444:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:0.0:1787583101.178635:0:8444:0:(genops.c:1385:class_connect()) connect: client c54c7da2-d1ec-4db9-98d7-e170a1f2cfae, cookie 0x19a47956376b6534 00002000:00100000:0.0:1787583101.178649:0:8444:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c54c7da2-d1ec-4db9-98d7-e170a1f2cfae/ffff9093453a3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787583101.178668:0:8444:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787583101.178761:0:8444:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787583101.178791:0:8444:0:(import.c:65:import_set_state_nolock()) ffff9093453a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787583101.178936:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2403:x1874416413738368:12345-192.168.203.11@tcp:8:bash.0 Request processed in 370us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583101.178975:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1787583101.181664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583101.181748:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413738496 00000100:00100000:2.0:1787583101.181758:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413738496 00000100:00100000:2.0:1787583101.181836:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1787583101.181878:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:0:x1874416413738496:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1787583101.181895:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583101.181917:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b653b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41a7 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787583101.181943:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787583101.181961:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=408s v=(0 0) 00000100:00080000:3.0:1787583101.182284:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787583101.182430:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583101.182441:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b653b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a7 expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.182463:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b653b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a7 expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.182494:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a800, rc 0) 00000100:00100000:2.0:1787583101.182568:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:0:x1874416413738496:12345-192.168.203.11@tcp:101:bash.0 Request processed in 722us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583101.182575:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1787583101.190316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583101.190415:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413738624 00000100:00100000:1.0:1787583101.190426:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413738624 00000100:00100000:1.0:1787583101.190484:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1787583101.190494:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:11150:x1874416413738624:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1787583101.190512:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583101.190544:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41ae expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.190575:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b653b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a7 expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.190605:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583101.190609:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583101.190615:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 8 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.190653:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b653b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a7 expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.190668:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b653b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a7 expref: 8 pid: 8442 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583101.190683:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8445:1874416435851776:192.168.203.11@tcp:104: 00000100:00100000:1.0:1787583101.190788:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff909346bea600 going to sleep for 11 seconds 00000100:00100000:3.0:1787583101.193970:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.194274:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413738752 00000100:00100000:0.0:1787583101.194284:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413738752 00010000:00010000:0.0:1787583101.194324:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b653b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a7 expref: 9 pid: 8442 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583101.194367:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1787583101.194377:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373f53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2406:x1874416413738752:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583101.194390:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583101.194411:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b653b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a7 expref: 9 pid: 8442 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.194425:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b653b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a7 expref: 9 pid: 8442 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.194450:0:6512:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583101.194455:0:6512:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583101.194462:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 9 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.194472:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 9 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.194508:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 9 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583101.194555:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6512:1874416435851904:192.168.203.11@tcp:105: 00000100:00100000:0.0:1787583101.194643:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0000 going to sleep for 11 seconds 00010000:00010000:1.0:1787583101.195466:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b653b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a7 expref: 9 pid: 8442 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583101.195487:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8445:1874416435851776:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583101.195513:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 8 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.195534:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52c00, rc 0) 00000100:00100000:1.0:1787583101.195584:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:11150:x1874416413738624:12345-192.168.203.11@tcp:101:bash.0 Request processed in 5091us (5277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583101.195604:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1787583101.197356:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245890000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6512:1874416435851904:192.168.203.11@tcp:105: 00010000:00010000:1.0:1787583101.197382:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583101.197430:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373f53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413738752:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 3053us (3474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583101.197441:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:3.0:1787583101.201689:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.202097:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413739008 00000100:00100000:0.0:1787583101.202107:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413739008 00000100:00100000:0.0:1787583101.202211:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:0.0:1787583101.202223:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:11150:x1874416413739008:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:0.0:1787583101.202534:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:11150:x1874416413739008:12345-192.168.203.11@tcp:35:bash.0 Request processed in 311us (850us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787583101.202541:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:0.0:1787583101.318968:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583101.319079:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413739264 00000100:00100000:2.0:1787583101.319090:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413739264 00000100:00100000:2.0:1787583101.319159:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1787583101.319170:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:11160:x1874416413739264:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583101.319196:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583101.319216:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6549 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41b5 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583101.319315:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787583101.319421:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6549 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41b5 expref: 18 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.319435:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013e00) 00010000:00010000:2.0:1787583101.319438:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787583101.319443:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6549 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41b5 expref: 18 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.319458:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a800, rc 0) 00000100:00100000:2.0:1787583101.319529:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+17:11160:x1874416413739264:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 353us (563us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1787583101.319559:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:3.0:1787583101.323504:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1787583101.326217:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583101.330745:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413739520 00000100:00100000:2.0:1787583101.330762:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413739520 00000100:00100000:2.0:1787583101.331126:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1787583101.331141:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+17:11160:x1874416413739520:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1787583101.331389:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:11160:x1874416413739520:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 251us (7894us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787583101.331397:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1787583101.413733:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.414191:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413739648 00000100:00100000:0.0:1787583101.414203:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413739648 00000100:00100000:0.0:1787583101.414379:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:0.0:1787583101.414390:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:11166:x1874416413739648:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583101.414415:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583101.414435:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6557 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41bc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.414502:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b655e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.414516:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b655e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.414545:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b655e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583101.414612:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787583101.414616:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583101.414640:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b655e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.414667:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6557 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41bc expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.414686:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b655e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41bc expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.414694:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583101.414697:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583101.414701:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fc00, rc 0) 00000100:00100000:0.0:1787583101.414766:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:11166:x1874416413739648:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 378us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583101.414773:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:1.0:1787583101.422949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583101.423341:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413739904 00000100:00100000:3.0:1787583101.423351:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413739904 00000100:00100000:3.0:1787583101.423467:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:3.0:1787583101.423478:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:11166:x1874416413739904:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1787583101.423500:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583101.423528:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6565 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.423638:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b656c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.423651:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b656c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.423662:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b656c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583101.423673:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787583101.423899:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6565 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41c3 expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.423918:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b656c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41c3 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.423927:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909351203d00) 00010000:00010000:3.0:1787583101.423930:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787583101.423934:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344decc00, rc 0) 00000100:00100000:3.0:1787583101.424004:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:11166:x1874416413739904:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 527us (1165us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787583101.424027:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:2.0:1787583101.428257:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583101.428317:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413740032 00000100:00100000:1.0:1787583101.428327:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413740032 00000100:00100000:1.0:1787583101.428394:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1787583101.428547:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:2404:x1874416413740032:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583101.428564:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583101.428589:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b656c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41c3 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.428607:0:13742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909351203d00) 00010000:00010000:1.0:1787583101.428612:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583101.428665:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:2404:x1874416413740032:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 123us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583101.428719:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1787583101.432466:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.433035:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413740288 00000100:00100000:0.0:1787583101.433045:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413740288 00000100:00100000:0.0:1787583101.433104:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:0.0:1787583101.433115:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:11166:x1874416413740288:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583101.433140:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583101.433160:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b657a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41ca expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.433255:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6581 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.433299:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6581 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.433311:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6581 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583101.433324:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787583101.433427:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b657a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ca expref: 23 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.433445:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6581 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ca expref: 22 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.433454:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909351203d00) 00010000:00010000:0.0:1787583101.433456:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787583101.433460:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713ec00, rc 0) 00000100:00100000:0.0:1787583101.433531:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:11166:x1874416413740288:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 418us (1076us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787583101.433539:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:2.0:1787583101.442413:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.443076:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413740416 00000100:00100000:0.0:1787583101.443087:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413740416 00000100:00100000:0.0:1787583101.443140:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:0.0:1787583101.443150:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413740416:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:0.0:1787583101.443192:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.443212:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.443233:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583101.443238:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583101.443242:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.443278:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.443298:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 7 pid: 8445 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583101.443313:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d838a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8442:1874416435852032:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583101.443418:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583101.448265:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.448395:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d838a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8442:1874416435852032:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583101.448422:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583101.452165:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413740544 00000100:00100000:1.0:1787583101.452182:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413740544 00002000:00100000:1.0:1787583101.452236:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff909352911880 x1874416413740544/t0(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:567/0 lens 504/0 e 0 to 0 dl 1787583112 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787583101.452268:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff909352911880 with x1874416413740544 ext(0->12) 00010000:00010000:1.0:1787583101.452278:0:8448:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 8 pid: 8445 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.452295:0:8448:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 8 pid: 8445 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787583101.452304:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff909352911880 00000100:00100000:1.0:1787583101.453017:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:1.0:1787583101.453030:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2406:x1874416413740544:12345-192.168.203.11@tcp:4:lfs.0 00000001:00100000:2.0:1787583101.460034:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000100:00100000:1.0:1787583101.462540:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2406:x1874416413740544:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 9503us (14273us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787583101.462554:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00002000:00100000:1.0:1787583101.462569:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff909352911880 x1874416413740544/t4294967300(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:567/0 lens 504/448 e 0 to 0 dl 1787583112 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787583101.462579:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff909352911880 with x1874416413740544 ext(0->12) 00010000:00010000:1.0:1787583101.462590:0:8448:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 9 pid: 8445 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.462608:0:8448:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 9 pid: 8445 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787583101.462616:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff909352911880 00000100:00100000:3.0:1787583101.467357:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583101.468024:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413740672 00000100:00100000:2.0:1787583101.468035:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413740672 00010000:00010000:2.0:1787583101.468090:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 9 pid: 8445 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583101.468187:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:2.0:1787583101.468197:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413740672:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583101.468213:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787583101.468231:0:6514:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787583101.468234:0:6514:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787583099 00002000:00010000:2.0:1787583101.468236:0:6514:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787583100 00002000:00010000:2.0:1787583101.468238:0:6514:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787583099 00002000:00010000:2.0:1787583101.468240:0:6514:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787583101.468262:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 9 pid: 8445 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.468275:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 9 pid: 8445 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.468298:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000538f4acb/0x19a47956376b6542 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ae expref: 9 pid: 8445 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.468313:0:6514:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787583101.468317:0:6514:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787583101.468323:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.468331:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.468365:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583101.468422:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2407:x1874416413740672:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 226us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583101.468430:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00010000:00010000:0.0:1787583101.471161:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.471181:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.471212:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.471238:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.471247:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.471254:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fa00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583101.471259:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.471267:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.471286:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.471293:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015db0162/0x19a47956376b658f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583101.471402:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413740416:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 28248us (28994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583101.471412:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:3.0:1787583101.475105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.475274:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413740928 00000100:00100000:0.0:1787583101.475284:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413740928 00000100:00100000:0.0:1787583101.475339:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:0.0:1787583101.475364:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:11166:x1874416413740928:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:0.0:1787583101.475562:0:6530:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6581 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ca expref: 22 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787583101.479164:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1787583101.479312:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787583101.480301:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1787583101.480413:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.480433:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6526 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a0 expref: 26 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.480441:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.480480:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a0 expref: 26 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.480497:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a0 expref: 26 pid: 6528 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583101.480651:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d838a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6530:1874416435852160:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583101.480756:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583101.484460:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d838a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6530:1874416435852160:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583101.484493:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583101.485443:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583101.486198:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413741056 00000100:00100000:1.0:1787583101.486216:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413741056 00010000:00010000:1.0:1787583101.486255:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a0 expref: 27 pid: 6528 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583101.486299:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:1.0:1787583101.486309:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:2406:x1874416413741056:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583101.486323:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583101.486330:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a0 expref: 27 pid: 6528 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.486343:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a0 expref: 27 pid: 6528 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.486364:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6526 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41a0 expref: 27 pid: 6528 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.486381:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909351203d00) 00010000:00010000:1.0:1787583101.486386:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.486395:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.486403:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.486433:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583101.486489:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+26:2406:x1874416413741056:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 180us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583101.486505:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00010000:00010000:2.0:1787583101.486541:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583101.486549:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787583101.486663:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1787583101.486806:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1787583101.487089:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e36a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6530:1874416435852288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787583101.487138:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583101.487163:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247690180 going to sleep for 11 seconds 00000100:00100000:3.0:1787583101.487558:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435852288 00000100:00100000:3.0:1787583101.487564:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435852288 00000100:00100000:3.0:1787583101.487617:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787583101.487625:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6530:x1874416435852288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787583101.487704:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6530:x1874416435852288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583101.487711:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1787583101.487746:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583101.487784:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e36a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6530:1874416435852288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787583101.488197:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1787583101.488250:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90934881ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6530:1874416435852416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787583101.488281:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583101.488308:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092464736c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583101.488407:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435852416 00000100:00100000:2.0:1787583101.488413:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435852416 00000100:00100000:2.0:1787583101.488444:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787583101.488452:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6530:x1874416435852416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787583101.488639:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6530:x1874416435852416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 187us (357us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787583101.488646:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787583101.489455:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90934881ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6530:1874416435852416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787583101.489630:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1787583101.489675:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.489685:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.489692:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.489699:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583101.489703:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.489710:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.489726:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909351203d00) 00010000:00010000:0.0:1787583101.489729:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787583101.490058:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.490066:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6596 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787583101.490181:0:6530:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787583101.490246:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787583101.490258:0:6530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 408643411476ns, next at 409643409067ns, rc = 0 00000001:00080000:0.0:1787583101.490264:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1787583101.490307:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909351203d00) 00010000:00010000:0.0:1787583101.490310:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787583101.490317:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6581 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ca expref: 30 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583101.490478:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:11166:x1874416413740928:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 15115us (15381us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1787583101.490487:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000020:00080000:0.0:1787583101.490492:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787583101.495105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.495442:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413741184 00000100:00100000:0.0:1787583101.495452:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413741184 00000100:00100000:0.0:1787583101.495631:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:0.0:1787583101.495643:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:11166:x1874416413741184:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583101.495667:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583101.495687:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b659d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41d1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.495751:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b659d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41d1 expref: 30 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.495767:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b659d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41d1 expref: 30 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.495784:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583101.495787:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787583101.495790:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fa00, rc 0) 00000100:00100000:0.0:1787583101.495883:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+30:11166:x1874416413741184:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 242us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583101.495908:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:3.0:1787583101.498233:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583101.498328:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413741440 00000100:00100000:1.0:1787583101.498338:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413741440 00000100:00100000:1.0:1787583101.498395:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1787583101.498411:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+30:11166:x1874416413741440:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1787583101.498664:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+31:11166:x1874416413741440:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 258us (439us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787583101.498676:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:3.0:1787583101.565390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.565510:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413741696 00000100:00100000:0.0:1787583101.565528:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413741696 00000100:00100000:0.0:1787583101.565592:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:0.0:1787583101.565604:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+31:11176:x1874416413741696:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583101.565629:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583101.565650:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583101.565785:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787583101.566198:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41d8 expref: 33 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.566213:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013e00) 00010000:00010000:0.0:1787583101.566216:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787583101.566222:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41d8 expref: 33 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.566236:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713ec00, rc 0) 00000100:00100000:0.0:1787583101.566296:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:11176:x1874416413741696:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 694us (920us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1787583101.566304:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:2.0:1787583101.571172:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.571350:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413741824 00000100:00100000:0.0:1787583101.571360:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413741824 00000100:00100000:0.0:1787583101.571451:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:0.0:1787583101.571462:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:11176:x1874416413741824:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1787583101.571566:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.571582:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.571593:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.571606:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.571614:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.571620:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.571701:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.571709:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.571716:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787583101.572105:0:13828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572119:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572138:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572144:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572151:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583101.572155:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572163:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572176:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583101.572179:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583101.572185:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572191:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572205:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572211:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572216:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572220:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583101.572229:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572235:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572243:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909345181600) 00010000:00010000:0.0:1787583101.572245:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583101.572248:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572253:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572262:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572267:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572273:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572277:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583101.572280:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572285:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572292:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583101.572294:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583101.572303:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.572309:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583101.572494:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:11176:x1874416413741824:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 1030us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583101.572502:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:3.0:1787583101.574470:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583101.574570:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413742080 00000100:00100000:1.0:1787583101.574580:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413742080 00000100:00100000:1.0:1787583101.574656:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1787583101.574664:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:11176:x1874416413742080:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1787583101.575236:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+33:11176:x1874416413742080:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 570us (771us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787583101.575243:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1787583101.609351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.609511:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413742336 00000100:00100000:0.0:1787583101.609531:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413742336 00000100:00100000:0.0:1787583101.609617:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:0.0:1787583101.609627:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+33:11179:x1874416413742336:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583101.609650:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583101.609668:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41df expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.609737:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.609750:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.609761:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.609771:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.609778:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.609807:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610227:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610235:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610243:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583101.610252:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787583101.610346:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610353:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610358:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610364:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583101.610368:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610375:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610386:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583101.610390:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583101.610401:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610407:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b65ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610423:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610429:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610435:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610441:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583101.610444:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610449:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610457:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909345181600) 00010000:00010000:0.0:1787583101.610459:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583101.610461:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610466:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b65d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610503:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41df expref: 36 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610541:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41df expref: 35 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.610549:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583101.610552:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787583101.610554:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713ec00, rc 0) 00000100:00100000:0.0:1787583101.610622:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+35:11179:x1874416413742336:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 997us (1281us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787583101.610630:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1787583101.614191:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.614285:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413742464 00000100:00100000:0.0:1787583101.614293:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413742464 00000100:00100000:0.0:1787583101.614440:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:0.0:1787583101.614452:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+35:11179:x1874416413742464:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1787583101.614512:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b65ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.614537:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b65ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.614547:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b65ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.614584:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b65ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.614591:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b65ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.614617:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b65ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.614623:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583101.614627:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b65ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.614634:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b65ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.614645:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583101.614648:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787583101.614653:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b65ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.614658:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b65ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583101.614731:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+35:11179:x1874416413742464:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 282us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583101.614739:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:3.0:1787583101.619110:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.619193:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413742720 00000100:00100000:0.0:1787583101.619202:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413742720 00000100:00100000:0.0:1787583101.619257:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1787583101.619267:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+35:11179:x1874416413742720:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1787583101.619504:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+36:11179:x1874416413742720:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 238us (405us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787583101.619511:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:1.0:1787583101.853664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.856878:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413742976 00000100:00100000:0.0:1787583101.856893:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413742976 00000100:00100000:0.0:1787583101.856969:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:0.0:1787583101.856981:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+36:11210:x1874416413742976:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:0.0:1787583101.857015:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583101.857035:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b65f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41e6 expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.857141:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.857155:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.857179:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583101.857191:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787583101.857311:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b65f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41e6 expref: 39 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.857330:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41e6 expref: 38 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.857339:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583101.857342:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787583101.857345:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e800, rc 0) 00000100:00100000:0.0:1787583101.857404:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:11210:x1874416413742976:12345-192.168.203.11@tcp:101:cat.0 Request processed in 425us (3751us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787583101.857431:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:2.0:1787583101.862910:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.862992:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413743232 00000100:00100000:0.0:1787583101.863010:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413743232 00000100:00100000:0.0:1787583101.863071:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1787583101.863081:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:11210:x1874416413743232:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:0.0:1787583101.863562:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+39:11210:x1874416413743232:12345-192.168.203.11@tcp:35:cat.0 Request processed in 479us (657us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787583101.863572:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:3.0:1787583101.863642:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.863741:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413743360 00000100:00100000:0.0:1787583101.863747:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413743360 00000100:00100000:0.0:1787583101.863788:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:0.0:1787583101.863796:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+39:2407:x1874416413743360:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583101.863812:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583101.863836:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b65f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41e6 expref: 39 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.863879:0:13742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583101.863883:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583101.863910:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:2407:x1874416413743360:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 115us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583101.863917:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1787583101.903049:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435852544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583101.903122:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583101.903366:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90934881dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435852672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787583101.903409:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583101.903594:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435852544 00000100:00100000:3.0:1787583101.903603:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435852544 00000100:00100000:3.0:1787583101.903684:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435852672 00000100:00100000:3.0:1787583101.903689:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435852672 00000100:00100000:1.0:1787583101.903715:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1787583101.903736:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583101.903737:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435852544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787583101.903767:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583101.903819:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435852544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583101.903925:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435852544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583101.908107:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787583101.908138:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435852672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787583101.908167:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583101.908262:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435852672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (4851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583101.908269:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787583101.908558:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90934881dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435852672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583101.912946:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787583101.948745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583101.948895:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413743616 00000100:00100000:0.0:1787583101.948905:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413743616 00000100:00100000:0.0:1787583101.949077:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:0.0:1787583101.949089:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:11216:x1874416413743616:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:0.0:1787583101.949133:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583101.949137:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787583101.949163:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b655e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41bc expref: 38 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.949183:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583101.949187:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787583101.949199:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6606 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41ed expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.949302:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.949317:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41df expref: 38 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.949326:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.949372:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41df expref: 38 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.949386:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41df expref: 38 pid: 6529 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583101.949401:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d838a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435852800:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583101.949494:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935aff0000 going to sleep for 11 seconds 00000100:00100000:0.0:1787583101.954793:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d838a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435852800:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583101.954884:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583101.955952:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583101.956097:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413743744 00000100:00100000:3.0:1787583101.956105:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413743744 00010000:00010000:3.0:1787583101.956144:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41df expref: 39 pid: 6529 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583101.956188:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:3.0:1787583101.956199:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d838a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+39:2406:x1874416413743744:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583101.956214:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583101.956221:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41df expref: 39 pid: 6529 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.956234:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41df expref: 39 pid: 6529 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.956255:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b65dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41df expref: 39 pid: 6529 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.956271:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:3.0:1787583101.956276:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.956296:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.956304:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.956327:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583101.956374:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d838a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:2406:x1874416413743744:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 176us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583101.956382:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00010000:00010000:0.0:1787583101.957133:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.957143:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583101.957163:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787583101.957322:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6606 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ed expref: 39 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.957339:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ed expref: 38 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583101.957352:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583101.957354:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787583101.957366:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e600, rc 0) 00000100:00100000:0.0:1787583101.957412:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:11216:x1874416413743616:12345-192.168.203.11@tcp:101:dd.0 Request processed in 8325us (8676us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787583101.957419:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:0.0:1787583101.967469:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583101.967556:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413743872 00000100:00100000:3.0:1787583101.967566:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413743872 00000100:00100000:3.0:1787583101.967624:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1787583101.967634:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:11216:x1874416413743872:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:3.0:1787583101.967660:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583101.967678:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b661b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41f4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.967712:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6622 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.967735:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.967747:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.967915:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b661b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41f4 expref: 40 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.967951:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41f4 expref: 39 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583101.967973:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:3.0:1787583101.967977:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787583101.967981:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344deda00, rc 0) 00000100:00100000:3.0:1787583101.968051:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+39:11216:x1874416413743872:12345-192.168.203.11@tcp:101:dd.0 Request processed in 418us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583101.968059:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1787583101.971754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583101.971890:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413744128 00000100:00100000:1.0:1787583101.971901:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413744128 00000100:00100000:1.0:1787583101.971966:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1787583101.971977:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+39:11216:x1874416413744128:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:1.0:1787583101.972208:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6629 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.972227:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.972243:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787583101.972290:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1787583101.972311:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006311da2b reply state 00000000d30a2768 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.972323:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6629 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583101.972331:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:1.0:1787583101.972334:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787583101.972338:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787583101.972601:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+42:11216:x1874416413744128:12345-192.168.203.11@tcp:36:dd.0 Request processed in 624us (859us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1787583101.972610:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000020:00080000:1.0:1787583101.972614:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787583102.350396:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583102.407686:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583102.408178:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413744256 00000100:00100000:0.0:1787583102.408188:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413744256 00000100:00100000:0.0:1787583102.408294:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:0.0:1787583102.408305:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+42:11230:x1874416413744256:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:0.0:1787583102.408345:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583102.408434:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6630 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c41fb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.408498:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6637 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.408524:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6637 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.408535:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6637 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.408546:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b663e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.408552:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b663e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.408558:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b663e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.408642:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6645 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.408654:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ed expref: 43 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.408663:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6645 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.408697:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ed expref: 43 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.408717:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ed expref: 43 pid: 6529 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583102.409213:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435852928:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583102.409372:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787583102.413185:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583102.413285:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413744512 00000100:00100000:2.0:1787583102.413294:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413744512 00000100:00100000:2.0:1787583102.413352:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1787583102.413440:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+44:9937:x1874416413744512:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787583102.413781:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+45:9937:x1874416413744512:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 344us (604us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787583102.413790:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:0.0:1787583102.413942:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435852928:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583102.413980:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6645 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583102.421623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583102.421717:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413744640 00000100:00100000:0.0:1787583102.421726:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413744640 00010000:00010000:0.0:1787583102.421767:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ed expref: 45 pid: 6529 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583102.421894:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:0.0:1787583102.421906:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+45:2407:x1874416413744640:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583102.421922:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583102.421930:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ed expref: 45 pid: 6529 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.421943:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ed expref: 45 pid: 6529 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.421977:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b660d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41ed expref: 45 pid: 6529 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.422012:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583102.422017:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6645 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.422027:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.422035:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6645 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.422067:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583102.422121:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+44:2407:x1874416413744640:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 217us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583102.422130:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00010000:00010000:2.0:1787583102.422237:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422246:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583102.422300:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787583102.422304:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583102.422345:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422358:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422369:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6637 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422376:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6637 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422383:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6637 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422389:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583102.422393:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6637 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422400:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6637 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422409:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:2.0:1787583102.422412:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583102.422423:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6637 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422429:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6637 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422441:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b663e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422447:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b663e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422453:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b663e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422458:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583102.422461:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b663e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422468:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b663e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422475:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909345181600) 00010000:00010000:2.0:1787583102.422478:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583102.422480:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b663e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422486:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b663e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422526:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6630 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41fb expref: 44 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422553:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41fb expref: 43 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.422561:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:2.0:1787583102.422563:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583102.422565:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e000, rc 0) 00000100:00100000:2.0:1787583102.422594:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:11230:x1874416413744256:12345-192.168.203.11@tcp:101:stat.0 Request processed in 14291us (14919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583102.422602:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1787583102.506600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583102.506694:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413744896 00000100:00100000:0.0:1787583102.506705:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413744896 00000100:00100000:0.0:1787583102.506767:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:0.0:1787583102.506778:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:11236:x1874416413744896:12345-192.168.203.11@tcp:36:truncate.0 00010000:00010000:0.0:1787583102.506831:0:13828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583102.506900:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6645 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41fb expref: 43 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.506919:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583102.506924:0:13828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787583102.507237:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b664c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.507253:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b664c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.507268:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b664c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787583102.507315:0:13828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1787583102.507336:0:13828:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018501822 reply state 0000000001ce295c transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b664c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.507350:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b664c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.507356:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583102.507359:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787583102.507362:0:13828:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787583102.507585:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+45:11236:x1874416413744896:12345-192.168.203.11@tcp:36:truncate.0 Request processed in 807us (993us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787583102.507593:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000020:00080000:0.0:1787583102.507598:0:13828:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787583102.661674:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583102.661781:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413745024 00000100:00100000:1.0:1787583102.661792:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413745024 00000100:00100000:1.0:1787583102.661887:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:1.0:1787583102.661900:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+45:11250:x1874416413745024:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:1.0:1787583102.661925:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583102.661946:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6653 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4202 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662023:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b665a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662037:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b665a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662047:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b665a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662058:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b6661 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662064:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b6661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662070:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b6661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662148:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662155:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662178:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583102.662221:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787583102.662226:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787583102.662245:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662257:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662264:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b665a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662270:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b665a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662277:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b665a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662281:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583102.662298:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b665a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662306:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b665a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662316:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:1.0:1787583102.662319:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583102.662323:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b665a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662339:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b665a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662353:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b6661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662359:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b6661 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662365:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b6661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662369:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53c00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583102.662373:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b6661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662379:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b6661 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662386:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909345181600) 00010000:00010000:1.0:1787583102.662389:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583102.662392:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b6661 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662398:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b6661 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662427:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6653 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4202 expref: 47 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662439:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4202 expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.662452:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:1.0:1787583102.662454:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787583102.662457:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52800, rc 0) 00000100:00100000:1.0:1787583102.662537:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+46:11250:x1874416413745024:12345-192.168.203.11@tcp:101:stat.0 Request processed in 640us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583102.662545:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:3.0:1787583102.744760:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583102.745087:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413745280 00000100:00100000:2.0:1787583102.745109:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413745280 00000100:00100000:2.0:1787583102.745182:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1787583102.745193:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+46:11260:x1874416413745280:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583102.745213:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583102.745233:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b666f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4209 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583102.745503:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787583102.745624:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b666f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4209 expref: 48 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.745641:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013e00) 00010000:00010000:2.0:1787583102.745644:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787583102.745651:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b666f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4209 expref: 48 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.745684:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770bc00, rc 0) 00000100:00100000:2.0:1787583102.745753:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+47:11260:x1874416413745280:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 561us (1002us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1787583102.745761:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1787583102.754179:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583102.757649:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413745536 00000100:00100000:0.0:1787583102.757663:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413745536 00000100:00100000:0.0:1787583102.757737:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1787583102.757749:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+47:11260:x1874416413745536:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1787583102.758245:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+48:11260:x1874416413745536:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 496us (4073us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787583102.758254:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:3.0:1787583102.809246:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583102.809349:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413745792 00000100:00100000:0.0:1787583102.809359:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413745792 00000100:00100000:0.0:1787583102.809419:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1787583102.809429:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+48:11266:x1874416413745792:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1787583102.809467:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583102.809487:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b667d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4210 expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.809600:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.809615:0:13828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4202 expref: 49 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.809638:0:13828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.809673:0:13828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4202 expref: 49 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.809686:0:13828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4202 expref: 49 pid: 6527 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583102.809701:0:13828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435853056:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583102.809801:0:13828:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a005840 going to sleep for 11 seconds 00000100:00100000:3.0:1787583102.812448:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583102.812982:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413745920 00000100:00100000:1.0:1787583102.812992:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413745920 00010000:00010000:1.0:1787583102.813035:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4202 expref: 50 pid: 6527 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583102.813076:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:1.0:1787583102.813087:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093770b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+50:2407:x1874416413745920:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583102.813100:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583102.813106:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4202 expref: 50 pid: 6527 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.813120:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4202 expref: 50 pid: 6527 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.813141:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:1.0:1787583102.813146:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.813156:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.813181:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.813198:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583102.813257:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093770b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+50:2407:x1874416413745920:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 171us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583102.813265:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00010000:00010000:0.0:1787583102.815593:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6668 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4202 expref: 49 pid: 6527 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583102.815618:0:13828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435853056:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583102.815644:0:13828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.815677:0:13828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.815683:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583102.815703:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787583102.815837:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b667d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4210 expref: 50 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.816063:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4210 expref: 49 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.816074:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583102.816077:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787583102.816081:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e800, rc 0) 00000100:00100000:0.0:1787583102.816148:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+49:11266:x1874416413745792:12345-192.168.203.11@tcp:101:bash.0 Request processed in 6720us (6910us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787583102.816157:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:3.0:1787583102.819765:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583102.820104:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413746176 00000100:00100000:0.0:1787583102.820114:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413746176 00000100:00100000:0.0:1787583102.820180:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:0.0:1787583102.820190:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+49:11266:x1874416413746176:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:0.0:1787583102.820447:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6692 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.820464:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6692 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.820481:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6692 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787583102.820553:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1787583102.820578:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003213428a reply state 000000000d8dced2 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6692 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.820591:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6692 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.820599:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583102.820601:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787583102.820604:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787583102.820694:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+52:11266:x1874416413746176:12345-192.168.203.11@tcp:36:bash.0 Request processed in 504us (936us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1787583102.820701:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000020:00080000:0.0:1787583102.820705:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787583102.826670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583102.828069:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413746304 00000100:00100000:0.0:1787583102.828081:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413746304 00000100:00100000:0.0:1787583102.828137:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1787583102.828148:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+52:11266:x1874416413746304:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1787583102.828171:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583102.828190:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6699 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4217 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.828279:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b66a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.828294:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4210 expref: 53 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.828320:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b66a0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.828357:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4210 expref: 53 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583102.828370:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4210 expref: 53 pid: 13828 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583102.828385:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435853184:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583102.828611:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff90935a005840 going to sleep for 11 seconds 00000100:00100000:0.0:1787583102.838133:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435853184:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583102.838162:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b66a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583102.840301:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583102.840543:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413746432 00000100:00100000:1.0:1787583102.840554:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413746432 00010000:00010000:1.0:1787583102.840596:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4210 expref: 54 pid: 13828 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583102.840685:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:1.0:1787583102.840696:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:2407:x1874416413746432:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583102.840710:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583102.840717:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4210 expref: 54 pid: 13828 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.840736:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4210 expref: 54 pid: 13828 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.840758:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6684 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4210 expref: 54 pid: 13828 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.840774:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:1.0:1787583102.840779:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b66a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.840808:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b66a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.840816:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b66a0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583102.840839:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583102.840960:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+53:2407:x1874416413746432:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 255us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583102.840969:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00010000:00010000:2.0:1787583102.841020:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b66a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.841029:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b66a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583102.841085:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787583102.841089:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583102.841113:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b66a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.841143:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6699 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4217 expref: 53 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.841157:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b66a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4217 expref: 52 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.841165:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:2.0:1787583102.841168:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583102.841170:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fc00, rc 0) 00000100:00100000:2.0:1787583102.841198:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+52:11266:x1874416413746304:12345-192.168.203.11@tcp:101:bash.0 Request processed in 13052us (14538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583102.841212:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1787583102.844557:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583102.844651:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413746688 00000100:00100000:2.0:1787583102.844660:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413746688 00000100:00100000:2.0:1787583102.844729:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:2.0:1787583102.844741:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+52:11266:x1874416413746688:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1787583102.845106:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+53:11266:x1874416413746688:12345-192.168.203.11@tcp:35:bash.0 Request processed in 365us (555us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787583102.845114:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:3.0:1787583102.926100:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435853312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583102.926170:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787583102.926269:0:10013:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410079422540ns, next at 411079419923ns, rc = 0 00000100:00100000:0.0:1787583102.926554:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435853312 00000100:00100000:0.0:1787583102.926562:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435853312 00000100:00100000:0.0:1787583102.926613:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787583102.926623:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874416435853312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787583102.926653:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787583102.928311:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435853824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583102.928367:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583102.933197:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435853696:0@lo:400:kworker.0 00000100:00100000:2.0:1787583102.933921:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583102.933974:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435854208:0@lo:400:kworker.0 00000100:00100000:2.0:1787583102.934262:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583102.934285:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fdbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435854720:0@lo:400:kworker.0 00000100:00100000:1.0:1787583102.934628:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435854208 00000100:00100000:3.0:1787583102.934637:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435853824 00000100:00100000:1.0:1787583102.934637:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435854208 00000100:00100000:3.0:1787583102.934645:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435853824 00000100:00100000:3.0:1787583102.934700:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435853696 00000100:00100000:3.0:1787583102.934705:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435853696 00000100:00100000:1.0:1787583102.934705:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787583102.934718:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435854208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.934736:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787583102.934757:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435853824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787583102.934783:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787583102.934831:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435853824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (6463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583102.934837:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787583102.935101:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583102.935133:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787583102.935151:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435854336:0@lo:400:kworker.0 00000100:00100000:2.0:1787583102.935178:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583102.935198:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fdbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435854848:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.935200:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787583102.935212:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435853696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583102.935229:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583102.935255:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435853696:12345-0@lo:400:kworker.0 Request processed in 44us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583102.935263:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787583102.935290:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435853696:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.935325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00080000:3.0:1787583102.935360:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787583102.935375:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435853568:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.935398:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583102.935413:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435854080:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.935430:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583102.935438:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fdbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435854592:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.935453:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583102.935463:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787583102.935468:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435853440:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.935489:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583102.935522:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435853952:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.935542:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583102.935552:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fdbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435854464:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.935567:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583102.935610:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435854336 00000100:00100000:3.0:1787583102.935614:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435854336 00000100:00100000:3.0:1787583102.935641:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435854848 00000100:00100000:3.0:1787583102.935643:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435854848 00000100:00100000:3.0:1787583102.935660:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435854464 00000100:00100000:3.0:1787583102.935663:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435854464 00000100:00100000:3.0:1787583102.935674:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787583102.935680:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435854336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583102.935889:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435854336:0@lo:400:kworker.0 00000100:00100000:2.0:1787583102.935911:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435853440 00000100:00100000:2.0:1787583102.935914:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435853440 00000100:00100000:2.0:1787583102.935950:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787583102.935956:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435853440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583102.936099:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787583102.936109:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435854848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.936162:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435854336:12345-0@lo:400:kworker.0 Request processed in 481us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583102.936170:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787583102.936184:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787583102.936191:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435854464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583102.936214:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435854848:12345-0@lo:400:kworker.0 Request processed in 106us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583102.936223:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787583102.936228:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435854464:12345-0@lo:400:kworker.0 Request processed in 37us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583102.936236:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787583102.936252:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435854720 00000100:00100000:1.0:1787583102.936258:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435854720 00000100:00080000:3.0:1787583102.936259:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583102.936271:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413746944 00000100:00100000:3.0:1787583102.936275:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413746944 00000100:00100000:1.0:1787583102.936291:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435853568 00000100:00100000:3.0:1787583102.936296:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435854080 00000100:00100000:3.0:1787583102.936300:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435854080 00000100:00100000:3.0:1787583102.936310:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435854592 00000100:00100000:3.0:1787583102.936312:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435854592 00000100:00100000:3.0:1787583102.936322:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435853952 00000100:00100000:3.0:1787583102.936324:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435853952 00000100:00100000:3.0:1787583102.936333:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787583102.936339:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435854720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.936363:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435854720:12345-0@lo:400:kworker.0 Request processed in 25us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583102.936375:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435853440:12345-0@lo:400:kworker.0 Request processed in 417us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583102.936382:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787583102.936390:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787583102.936400:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787583102.936407:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435854080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.936436:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435854080:12345-0@lo:400:kworker.0 Request processed in 30us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583102.936442:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787583102.936449:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435853440:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.936455:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787583102.936464:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435854592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583102.936470:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fdbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435854464:0@lo:400:kworker.0 00000100:00100000:2.0:1787583102.936489:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435854080:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.936494:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435854592:12345-0@lo:400:kworker.0 Request processed in 31us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583102.936500:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787583102.936505:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fdbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435854592:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.936527:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787583102.936534:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435853952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583102.936566:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fdbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435854848:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.936571:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435853952:12345-0@lo:400:kworker.0 Request processed in 36us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583102.936578:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00010000:00080000:2.0:1787583102.936586:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fdbbb80 x1874416435854720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583102.936593:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:3.0:1787583102.936603:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+53:11276:x1874416413746944:12345-192.168.203.11@tcp:101:lfs.0 00000100:00100000:2.0:1787583102.936604:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fdbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435854720:0@lo:400:kworker.0 00010000:00010000:3.0:1787583102.936622:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787583102.936636:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435853952:0@lo:400:kworker.0 00010000:00010000:3.0:1787583102.936646:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b66a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c421e expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787583102.936688:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583102.936692:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787583102.936736:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435853568 00000100:00100000:1.0:1787583102.936904:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787583102.936911:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435853568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583102.936954:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435853568:12345-0@lo:400:kworker.0 Request processed in 44us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583102.936966:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000004:00200000:3.0:1787583102.936973:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787583102.937078:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b66a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c421e expref: 55 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583102.937106:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013e00) 00010000:00010000:3.0:1787583102.937110:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787583102.937116:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b66a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c421e expref: 55 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583102.937129:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dec800, rc 0) 00000100:00100000:3.0:1787583102.937170:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:11276:x1874416413746944:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 567us (1846us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1787583102.937177:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:1.0:1787583102.937683:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435853568:0@lo:400:kworker.0 00000100:00100000:1.0:1787583102.937745:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435854208:12345-0@lo:400:kworker.0 Request processed in 3030us (3483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583102.937805:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00080000:2.0:1787583102.937886:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247e34380 x1874416435854208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583102.937898:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435854208:0@lo:400:kworker.0 00000100:00100000:3.0:1787583102.941554:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583102.941871:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413747072 00000100:00100000:2.0:1787583102.941881:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413747072 00000100:00100000:2.0:1787583102.941937:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:2.0:1787583102.941949:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:11276:x1874416413747072:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:2.0:1787583102.942091:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942108:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942121:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942132:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942151:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942158:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942236:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942246:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942253:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787583102.942529:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942543:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942560:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942568:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942574:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583102.942579:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942586:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942602:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:2.0:1787583102.942605:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583102.942609:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942615:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942630:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942636:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942642:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942648:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770ba00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583102.942658:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942665:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942673:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909345181600) 00010000:00010000:2.0:1787583102.942675:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583102.942678:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942682:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942693:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942699:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942705:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942709:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770bc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583102.942712:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942718:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942725:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:2.0:1787583102.942727:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583102.942736:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.942742:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583102.943229:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874416435853312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 16603us (17054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583102.943241:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787583102.943268:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435853312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787583102.943319:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435853824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583102.943370:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:11276:x1874416413747072:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 1422us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583102.943379:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:1.0:1787583102.949543:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583102.949943:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413747328 00000100:00100000:2.0:1787583102.949954:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413747328 00000100:00100000:2.0:1787583102.950005:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1787583102.950015:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:11276:x1874416413747328:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1787583102.950264:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+55:11276:x1874416413747328:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 237us (716us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787583102.950272:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1787583102.996367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583102.996578:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413747584 00000100:00100000:2.0:1787583102.996587:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413747584 00000100:00100000:2.0:1787583102.996700:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:2.0:1787583102.996711:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+55:11279:x1874416413747584:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583102.996753:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583102.996773:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4225 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.996908:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66d1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.996922:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.996943:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.996957:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.996964:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.996972:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997095:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b66df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997105:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b66df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997111:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b66df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583102.997121:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787583102.997204:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997211:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997218:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997224:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770ba00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583102.997235:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997253:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997266:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:2.0:1787583102.997269:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583102.997273:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997280:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b66d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997294:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997299:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997305:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997311:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583102.997314:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997319:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997326:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909345181600) 00010000:00010000:2.0:1787583102.997329:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583102.997339:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997345:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b66d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997385:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b66ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4225 expref: 58 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997399:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b66df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4225 expref: 57 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583102.997405:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:2.0:1787583102.997408:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583102.997410:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480a00, rc 0) 00000100:00100000:2.0:1787583102.997467:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+57:11279:x1874416413747584:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 758us (1108us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787583102.997474:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:3.0:1787583103.001807:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583103.004062:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583103.004462:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413747840 00000100:00100000:0.0:1787583103.004473:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413747840 00000100:00100000:0.0:1787583103.004571:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:0.0:1787583103.004599:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+57:2405:x1874416413747840:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583103.004618:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583103.004643:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b66df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4225 expref: 57 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.004664:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583103.004669:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583103.004736:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+56:2405:x1874416413747840:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 128us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583103.004745:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00080000:2.0:1787583103.004954:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787583103.007087:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413747712 00000100:00100000:1.0:1787583103.007101:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413747712 00000100:00100000:1.0:1787583103.007208:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:1.0:1787583103.007219:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+56:11279:x1874416413747712:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:1.0:1787583103.007282:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b66ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.007299:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b66ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.007310:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b66ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.007349:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b66ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.007357:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b66ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.007363:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b66ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.007383:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583103.007387:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b66ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.007394:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b66ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.007405:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:1.0:1787583103.007408:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787583103.007412:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b66ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.007417:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b66ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583103.007492:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+56:11279:x1874416413747712:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 275us (5704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583103.007499:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:3.0:1787583103.012672:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583103.012748:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413748096 00000100:00100000:2.0:1787583103.012756:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413748096 00000100:00100000:2.0:1787583103.012807:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1787583103.012816:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+56:11279:x1874416413748096:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1787583103.013044:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+57:11279:x1874416413748096:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 228us (380us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787583103.013051:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1787583103.218620:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583103.219095:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413748352 00000100:00100000:2.0:1787583103.219107:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413748352 00000100:00100000:2.0:1787583103.219193:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:2.0:1787583103.219204:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+57:11297:x1874416413748352:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:2.0:1787583103.219230:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583103.219251:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b66f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c422c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.219371:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b66fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.219386:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b66fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.219397:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b66fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583103.219407:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787583103.219537:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b66f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c422c expref: 60 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.219557:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b66fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c422c expref: 59 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.219566:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:2.0:1787583103.219569:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787583103.219573:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480000, rc 0) 00000100:00100000:2.0:1787583103.219640:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:11297:x1874416413748352:12345-192.168.203.11@tcp:101:cat.0 Request processed in 438us (1028us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1787583103.219648:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:3.0:1787583103.256202:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583103.256307:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413748480 00000100:00100000:2.0:1787583103.256330:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413748480 00000100:00100000:2.0:1787583103.256390:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:2.0:1787583103.256400:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:11298:x1874416413748480:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583103.256419:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583103.256438:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4233 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.256494:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6710 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.256516:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.256528:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583103.256572:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787583103.256575:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583103.256592:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.256615:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4233 expref: 61 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.256633:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6710 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4233 expref: 60 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.256641:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:2.0:1787583103.256644:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787583103.256647:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481600, rc 0) 00000100:00100000:2.0:1787583103.256705:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11298:x1874416413748480:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 307us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583103.256712:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:3.0:1787583103.263743:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583103.263874:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413748864 00000100:00100000:2.0:1787583103.263884:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413748864 00000100:00100000:2.0:1787583103.263930:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1787583103.263940:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11298:x1874416413748864:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1787583103.264205:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11298:x1874416413748864:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 266us (472us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787583103.264212:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1787583103.266749:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583103.266889:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413748992 00000100:00100000:2.0:1787583103.266898:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413748992 00000100:00100000:2.0:1787583103.266954:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:2.0:1787583103.266964:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11298:x1874416413748992:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:2.0:1787583103.266981:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787583103.267005:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b66a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4217 expref: 61 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.267027:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b66fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c422c expref: 60 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.267039:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b659d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41d1 expref: 59 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.267049:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:2.0:1787583103.267053:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583103.267116:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:11298:x1874416413748992:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 153us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583103.267124:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1787583103.270526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583103.270624:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413749120 00000100:00100000:1.0:1787583103.270634:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413749120 00000100:00100000:1.0:1787583103.270695:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:1.0:1787583103.270705:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:11298:x1874416413749120:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:1.0:1787583103.270915:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6717 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.270932:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6717 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.270944:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6717 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787583103.271224:0:13828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787583103.271396:0:13828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787583103.271493:0:13828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787583103.271598:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:11298:x1874416413749120:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 893us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583103.271608:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:3.0:1787583103.311265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583103.311399:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413749248 00000100:00100000:0.0:1787583103.311410:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413749248 00000100:00100000:0.0:1787583103.311474:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:0.0:1787583103.311485:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:11300:x1874416413749248:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583103.311514:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583103.311536:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b671e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c423a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.311596:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6725 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.311610:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6725 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.311620:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6725 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.311630:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b672c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.311651:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b672c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.311658:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b672c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.311740:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.311751:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.311758:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583103.311814:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787583103.311818:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583103.312491:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312518:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312528:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6725 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312535:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6725 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312541:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6725 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312562:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583103.312566:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6725 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312573:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6725 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312587:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583103.312590:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583103.312595:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6725 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312601:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6725 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312614:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b672c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312621:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b672c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312627:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b672c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312632:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713ec00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583103.312635:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b672c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312642:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b672c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312658:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909345181600) 00010000:00010000:0.0:1787583103.312661:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583103.312663:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b672c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312669:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b672c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312697:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b671e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c423a expref: 60 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312709:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c423a expref: 59 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.312725:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583103.312728:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583103.312730:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e000, rc 0) 00000100:00100000:0.0:1787583103.312807:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:11300:x1874416413749248:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1324us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583103.312817:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00010000:00010000:3.0:1787583103.374066:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583103.447663:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435854976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787583103.447745:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583103.448902:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435854976 00000100:00100000:3.0:1787583103.448912:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435854976 00000100:00100000:3.0:1787583103.448974:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787583103.448983:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435854976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787583103.449010:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787583103.449077:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435854976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583103.449085:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787583103.449229:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435854976:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1787583103.822453:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787583103.822461:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787583103.822490:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787583103.822496:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787583103.822626:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874416435855104:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787583103.823948:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91a80 going to sleep for 11 seconds 00000040:00080000:0.0:1787583103.824618:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787583103.832383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583103.832451:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413749376 00000100:00100000:2.0:1787583103.832461:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413749376 00000100:00100000:2.0:1787583103.832526:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1787583103.832537:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11311:x1874416413749376:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787583103.832568:0:6527:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787583103.832726:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11311:x1874416413749376:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 190us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583103.832735:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:3.0:1787583103.836089:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583103.836155:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413749504 00000100:00100000:2.0:1787583103.836165:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413749504 00000100:00100000:2.0:1787583103.836225:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:2.0:1787583103.836235:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11311:x1874416413749504:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787583103.836303:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b673a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836319:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b673a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836331:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b673a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836347:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6741 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836354:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6741 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836380:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6741 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836408:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6748 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836416:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836422:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583103.836470:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787583103.836474:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583103.836493:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836513:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b673a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836519:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b673a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836527:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b673a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836533:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583103.836537:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b673a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836543:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b673a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836562:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90937e015500) 00010000:00010000:2.0:1787583103.836565:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583103.836569:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b673a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836574:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b673a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836586:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6741 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836592:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6741 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836597:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6741 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836601:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583103.836604:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6741 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836609:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6741 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836615:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff909345181300) 00010000:00010000:2.0:1787583103.836617:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583103.836619:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6741 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.836624:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6741 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.837101:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.837110:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6748 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.837115:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6748 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.837119:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583103.837122:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6748 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.837128:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6748 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.837136:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:2.0:1787583103.837138:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583103.837141:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6748 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.837147:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6748 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583103.837231:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11311:x1874416413749504:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 995us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583103.837240:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:1.0:1787583103.839601:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874416435855104:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787583103.840698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583103.840831:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413749760 00000100:00100000:0.0:1787583103.840886:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413749760 00000100:00100000:0.0:1787583103.840938:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:0.0:1787583103.840949:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:11311:x1874416413749760:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787583103.840967:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583103.840988:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b674f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4241 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.841087:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6756 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.841102:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.841112:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583103.841122:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787583103.841192:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.841201:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6756 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.841207:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6756 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.841212:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583103.841217:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6756 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.841224:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6756 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.841244:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583103.841247:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583103.841252:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6756 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.841259:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6756 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.841298:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b674f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4241 expref: 61 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.841309:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90937e015500) 00010000:00010000:0.0:1787583103.841311:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787583103.841315:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b674f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4241 expref: 61 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.841323:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e800, rc 0) 00000100:00100000:0.0:1787583103.841380:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11311:x1874416413749760:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 432us (686us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1787583103.841386:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:3.0:1787583103.844550:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583103.844739:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413749888 00000100:00100000:0.0:1787583103.844749:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413749888 00000100:00100000:0.0:1787583103.844813:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:0.0:1787583103.844822:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11311:x1874416413749888:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787583103.844888:0:13828:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787583103.845006:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11311:x1874416413749888:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 184us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583103.845028:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:3.0:1787583103.848825:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583103.848932:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413750144 00000100:00100000:0.0:1787583103.848942:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413750144 00000100:00100000:0.0:1787583103.849002:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:0.0:1787583103.849013:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11311:x1874416413750144:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787583103.849036:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583103.849040:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787583103.849068:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6710 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4233 expref: 60 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.849089:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583103.849093:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787583103.849105:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6764 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4248 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787583103.849521:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787583103.849666:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b676b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.849679:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b676b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.849688:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b676b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.849739:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6764 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4248 expref: 62 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.849766:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b676b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4248 expref: 61 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.849774:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90937e013800) 00010000:00010000:0.0:1787583103.849777:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787583103.849779:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fa00, rc 0) 00000100:00100000:0.0:1787583103.849887:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11311:x1874416413750144:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 876us (1071us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787583103.849895:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:3.0:1787583103.854616:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583103.854819:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413750400 00000100:00100000:1.0:1787583103.854828:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413750400 00000100:00100000:1.0:1787583103.855089:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:1.0:1787583103.855100:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11311:x1874416413750400:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787583103.855157:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583103.855183:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b676b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4248 expref: 61 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855201:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90937e013800) 00010000:00010000:1.0:1787583103.855211:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583103.855232:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6779 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855263:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6779 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855272:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6779 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855287:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6780 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x671f14bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855293:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6780 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x671f14bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855300:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6780 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x671f14bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855352:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6779 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855359:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6779 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855365:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6779 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855370:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583103.855375:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6779 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855382:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6779 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855405:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:1.0:1787583103.855414:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583103.855419:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6779 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855425:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6779 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855435:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6780 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x671f14bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855441:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6780 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x671f14bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855447:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6780 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x671f14bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855452:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583103.855455:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6780 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x671f14bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855461:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6780 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x671f14bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855468:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x671f14bf (ffff9093427e3900) 00010000:00010000:1.0:1787583103.855471:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583103.855474:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6780 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x671f14bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.855479:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6780 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x671f14bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583103.855734:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11311:x1874416413750400:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 635us (1126us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787583103.855748:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:3.0:1787583103.858607:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583103.858687:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413750528 00000100:00100000:2.0:1787583103.858697:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413750528 00000100:00100000:2.0:1787583103.858768:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:2.0:1787583103.858800:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11311:x1874416413750528:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583103.858820:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583103.858872:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6787 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c424f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.858909:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b678e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.858922:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b678e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.858933:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b678e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.859041:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6787 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c424f expref: 62 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.859060:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b678e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c424f expref: 61 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.859068:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:2.0:1787583103.859071:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787583103.859074:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480200, rc 0) 00000100:00100000:2.0:1787583103.859594:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11311:x1874416413750528:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 802us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583103.859603:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:3.0:1787583103.866510:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583103.866548:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413750784 00000100:00100000:3.0:1787583103.866556:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413750784 00000100:00100000:3.0:1787583103.866605:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:3.0:1787583103.866614:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11311:x1874416413750784:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787583103.867497:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6795 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.867525:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6795 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.867537:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6795 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787583103.867782:0:7748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787583103.867793:0:7748:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411020946617ns, next at 412020943734ns, rc = 0 00000004:00010000:3.0:1787583103.868022:0:7748:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000efd278e9 reply state 00000000cfd782f9 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6795 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.868035:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.868058:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:3.0:1787583103.868061:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787583103.868064:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787583103.868159:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:11311:x1874416413750784:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1542us (1666us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787583103.868167:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:1.0:1787583103.870483:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583103.870569:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413750912 00000100:00100000:2.0:1787583103.870579:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413750912 00000100:00100000:2.0:1787583103.870741:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:2.0:1787583103.870765:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:11311:x1874416413750912:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583103.870798:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583103.870817:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b679c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4256 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.870896:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b679c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4256 expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.870911:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b679c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4256 expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.870928:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:2.0:1787583103.870931:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787583103.870935:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480000, rc 0) 00000100:00100000:2.0:1787583103.871030:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+64:11311:x1874416413750912:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 266us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583103.871037:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:3.0:1787583103.874415:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583103.876867:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413751040 00000100:00100000:1.0:1787583103.876880:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413751040 00000100:00100000:1.0:1787583103.876934:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:1.0:1787583103.876943:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1874416413751040:12345-192.168.203.11@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787583103.876979:0:8445:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:1.0:1787583103.877010:0:8445:0:(genops.c:1385:class_connect()) connect: client c54c7da2-d1ec-4db9-98d7-e170a1f2cfae, cookie 0x19a47956376b67a3 00002000:00100000:1.0:1787583103.877023:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c54c7da2-d1ec-4db9-98d7-e170a1f2cfae/ffff909247e55000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787583103.877041:0:8445:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787583103.877128:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787583103.877160:0:8445:0:(import.c:65:import_set_state_nolock()) ffff909247e51800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787583103.877228:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2403:x1874416413751040:12345-192.168.203.11@tcp:8:lhsmtool_posix.0 Request processed in 284us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583103.877236:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:3.0:1787583103.879869:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583103.880313:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413751168 00000100:00100000:0.0:1787583103.880323:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413751168 00000100:00100000:0.0:1787583103.880434:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1787583103.880444:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:0:x1874416413751168:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000001:00080000:1.0:1787583103.882665:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:1.0:1787583103.882679:0:8437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000100:00100000:0.0:1787583103.882989:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:0:x1874416413751168:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 2541us (3149us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787583103.882999:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00080000:3.0:1787583103.887227:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583103.887497:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583103.887926:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413751424 00000100:00100000:3.0:1787583103.887935:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413751424 00000100:00100000:3.0:1787583103.888030:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1787583103.888042:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+64:11311:x1874416413751424:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787583103.888274:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:11311:x1874416413751424:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 234us (783us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1787583103.888282:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1787583103.890466:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583103.890558:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413751680 00000100:00100000:0.0:1787583103.890567:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413751680 00000100:00100000:0.0:1787583103.890663:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:0.0:1787583103.890674:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:11311:x1874416413751680:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787583103.890798:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:11311:x1874416413751680:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 118us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583103.890806:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:1.0:1787583103.893199:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583103.893273:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413751808 00000100:00100000:3.0:1787583103.893283:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413751808 00000100:00100000:3.0:1787583103.893343:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:3.0:1787583103.893353:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:11311:x1874416413751808:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787583103.893371:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583103.893389:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b67aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c425d expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.893452:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b67b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.893477:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b67b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.893488:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b67b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583103.893545:0:13828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787583103.893565:0:13828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b67b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.893591:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b67aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c425d expref: 67 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.893610:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b67b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c425d expref: 66 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.893619:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:3.0:1787583103.893623:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787583103.893628:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344decc00, rc 0) 00000100:00100000:3.0:1787583103.895988:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:11311:x1874416413751808:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 2627us (2788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583103.896000:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:0.0:1787583103.901282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583103.901478:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413751936 00000100:00100000:2.0:1787583103.901487:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413751936 00000100:00100000:2.0:1787583103.901549:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:2.0:1787583103.901559:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413751936:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583103.901575:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583103.901594:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b67b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4264 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787583103.901616:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c5a7e, blocks: 0x0 00010000:00010000:2.0:1787583103.901635:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1787583103.901750:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583103.901761:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b67b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4264 expref: 6 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.901780:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b67b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4264 expref: 6 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583103.907029:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481400, rc 0) 00000100:00100000:2.0:1787583103.907117:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413751936:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 5554us (5838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583103.907127:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:2.0:1787583103.910410:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583103.912131:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413752192 00000100:00100000:3.0:1787583103.912143:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413752192 00000100:00100000:3.0:1787583103.912214:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:3.0:1787583103.912224:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:11311:x1874416413752192:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787583103.912334:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:11311:x1874416413752192:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 111us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583103.912349:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:2.0:1787583103.928739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583103.929558:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413752320 00000100:00100000:0.0:1787583103.929569:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413752320 00000100:00100000:0.0:1787583103.929623:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:0.0:1787583103.929633:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:11311:x1874416413752320:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787583103.929660:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583103.929680:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c426b expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.929708:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b67b8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4264 expref: 7 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.929727:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583103.929732:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583103.929738:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c426b expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.929770:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b67b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4264 expref: 7 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.929784:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b67b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4264 expref: 7 pid: 8445 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583103.929810:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8442:1874416435855232:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583103.929905:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff909350a78540 going to sleep for 11 seconds 00000100:00100000:3.0:1787583103.940823:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583103.940892:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8442:1874416435855232:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583103.940923:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c426b expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.940944:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713ec00, rc 0) 00000100:00100000:3.0:1787583103.940994:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:11311:x1874416413752320:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 11362us (12264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583103.941002:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:3.0:1787583103.941038:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413752448 00000100:00100000:3.0:1787583103.941044:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413752448 00010000:00010000:3.0:1787583103.941072:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b67b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4264 expref: 7 pid: 8445 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583103.941101:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:3.0:1787583103.941109:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413752448:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583103.941121:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583103.941140:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b67b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4264 expref: 7 pid: 8445 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.941153:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b67b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4264 expref: 7 pid: 8445 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.941177:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b67b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4264 expref: 7 pid: 8445 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.941204:0:6512:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583103.941208:0:6512:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583103.941216:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c426b expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.941226:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c426b expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.941257:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c426b expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583103.941272:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6512:1874416435855360:192.168.203.11@tcp:105: 00000100:00100000:3.0:1787583103.941319:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff90937cd26d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787583103.944037:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6512:1874416435855360:192.168.203.11@tcp:105: 00010000:00010000:3.0:1787583103.944062:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583103.944111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413752448:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 3000us (3294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583103.944120:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:3.0:1787583103.944986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583103.945172:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413752576 00000100:00100000:1.0:1787583103.945180:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413752576 00002000:00100000:1.0:1787583103.945222:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff909247eca300 x1874416413752576/t0(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:569/0 lens 504/0 e 0 to 0 dl 1787583114 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787583103.945232:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff909247eca300 with x1874416413752576 ext(0->8) 00002000:00010000:1.0:1787583103.945252:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff909247eca300 00000100:00100000:1.0:1787583103.945315:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:1.0:1787583103.945325:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413752576:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787583103.948049:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2404:x1874416413752576:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 2715us (3056us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787583103.948067:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00002000:00100000:2.0:1787583103.948078:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff909247eca300 x1874416413752576/t4294967303(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:569/0 lens 504/448 e 0 to 0 dl 1787583114 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787583103.948088:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff909247eca300 with x1874416413752576 ext(0->8) 00002000:00010000:2.0:1787583103.948094:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff909247eca300 00000100:00100000:3.0:1787583103.960938:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583103.961056:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413752704 00000100:00100000:0.0:1787583103.961065:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413752704 00000100:00100000:0.0:1787583103.961132:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:0.0:1787583103.961143:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:11311:x1874416413752704:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787583103.963319:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1787583103.963334:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1787583103.963366:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:2.0:1787583103.963400:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787583103.963412:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff909246473000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787583103.963417:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90936f0f5400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff909246473e40 00000020:00080000:2.0:1787583103.963431:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90936f0f5b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff909247728800 00000100:00100000:3.0:1787583103.964088:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435855488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787583103.964140:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583103.964187:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435855616:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787583103.964222:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583103.964256:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435855488 00000100:00100000:3.0:1787583103.964262:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435855488 00000100:00100000:3.0:1787583103.964304:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435855616 00000100:00100000:3.0:1787583103.964308:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435855616 00000100:00100000:3.0:1787583103.964329:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787583103.964337:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435855488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787583103.964460:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787583103.964463:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787583102 00002000:00010000:3.0:1787583103.964466:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787583103.964468:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787583102 -> 1787583102 00002000:00010000:3.0:1787583103.964470:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787583103.964514:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1874416435855488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (363us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787583103.964521:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787583103.964541:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787583103.964548:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435855616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787583103.964562:0:8444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1787583103.964586:0:8444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8c5a7b, atime: 0x6a8c5a7c, ctime: 0x6a8c5a7b, blocks: 0x8 00010000:00010000:3.0:1787583103.964594:0:8444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb28bee/0x19a47956376b67c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.964608:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=411s v=(0 0) 00010000:00010000:3.0:1787583103.964613:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583103.964619:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb28bee/0x19a47956376b67c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964754:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b64d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964763:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b64d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964771:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b64d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964777:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583103.964781:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b64d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964788:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b64d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964802:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff909345181d00) 00010000:00010000:0.0:1787583103.964804:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583103.964809:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b64d9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964815:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b64d9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964831:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b64e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964838:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b64e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964869:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b64e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964875:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583103.964878:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b64e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964885:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b64e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964893:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583103.964896:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583103.964899:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b64e0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964905:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b64e0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964919:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b651f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964926:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b651f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964932:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b651f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964937:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770ae00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583103.964940:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b651f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964956:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b651f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964964:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909345181600) 00010000:00010000:0.0:1787583103.964967:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583103.964970:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b651f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964976:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b651f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964993:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6629 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.964999:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6629 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965005:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6629 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965010:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583103.965013:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6629 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965019:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6629 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965027:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583103.965029:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583103.965032:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6629 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965047:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6629 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965059:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b664c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965065:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b664c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965071:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b664c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965076:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583103.965080:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b664c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965085:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b664c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965094:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583103.965096:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583103.965099:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b664c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965105:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b664c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965116:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6692 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965122:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6692 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965133:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6692 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965138:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583103.965141:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6692 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965148:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6692 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965156:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583103.965158:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583103.965161:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6692 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965166:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6692 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965177:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965183:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6795 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965188:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965193:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dede00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583103.965195:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965209:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6795 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965218:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:0.0:1787583103.965220:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787583103.965223:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6795 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.965231:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6795 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787583103.965248:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787583103.965399:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787583103.965457:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:11311:x1874416413752704:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 2446us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583103.965466:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00010000:00010000:3.0:1787583103.966607:0:8444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb28bee/0x19a47956376b67c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.966625:0:8444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb28bee/0x19a47956376b67c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583103.966633:0:8444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bb28bee/0x19a47956376b67c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787583103.966905:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787583103.966910:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787583103.971332:0:8444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787583103.971558:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3653:x1874416435855616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7006us (7330us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787583103.971569:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1787583103.971648:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff909247ec8700/2, rc 0, transno 4294967302 00000100:00100000:3.0:1787583103.971655:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435855616:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1787583103.971684:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff909247ec9180/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787583103.971690:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435855488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787583103.975004:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583103.975066:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413752832 00000100:00100000:3.0:1787583103.975074:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413752832 00000100:00100000:3.0:1787583103.975128:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:3.0:1787583103.975138:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2406:x1874416413752832:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787583103.975349:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583103.975358:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bb28bee/0x19a47956376b67c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.975371:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f400 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583103.975376:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb28bee/0x19a47956376b67c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.975385:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb28bee/0x19a47956376b67c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.975405:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bb28bee/0x19a47956376b67c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.975413:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb28bee/0x19a47956376b67c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583103.975441:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583103.975443:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583103.975445:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787583103.977817:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1787583103.977831:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1787583103.978004:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413752832:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 2862us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583103.978014:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:3.0:1787583103.985080:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583103.985244:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413753088 00000100:00100000:1.0:1787583103.985254:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413753088 00000100:00100000:1.0:1787583103.985320:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:1.0:1787583103.985331:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:11311:x1874416413753088:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787583103.985381:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583103.985408:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b67b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c425d expref: 14 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.985425:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:1.0:1787583103.985430:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583103.985459:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b67cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.985472:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b67cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.985482:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b67cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583103.985609:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093ca6c9a reply state 000000006b59ca80 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b67cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.985621:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b67cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583103.985641:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:1.0:1787583103.986738:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787583103.986746:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787583103.986887:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:11311:x1874416413753088:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1554us (1812us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1787583103.986896:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:1.0:1787583103.989364:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583103.999193:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413753216 00000100:00100000:3.0:1787583103.999206:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413753216 00000100:00100000:2.0:1787583103.999343:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1787583103.999354:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413753216:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787583103.999530:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787583103.999533:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787583102 -> 1787583101 00002000:00010000:2.0:1787583103.999536:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787583100 00002000:00010000:2.0:1787583103.999538:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787583102 -> 1787583101 00002000:00010000:2.0:1787583103.999540:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787583103.999600:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413753216:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 247us (10244us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787583103.999607:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:3.0:1787583104.001903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.002006:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413753472 00000100:00100000:1.0:1787583104.002015:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413753472 00000100:00100000:1.0:1787583104.002065:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:1.0:1787583104.002074:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:11311:x1874416413753472:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787583104.002131:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.002146:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b678e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c424f expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.002156:0:7748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.002187:0:7748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b678e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c424f expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.002199:0:7748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b678e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c424f expref: 15 pid: 6528 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583104.002213:0:7748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352911500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435855744:192.168.203.11@tcp:104: 00000100:00100000:1.0:1787583104.002311:0:7748:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c910c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583104.006983:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.007103:0:7748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352911500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435855744:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583104.007129:0:7748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583104.007196:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413753600 00000100:00100000:0.0:1787583104.007203:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413753600 00010000:00010000:0.0:1787583104.007240:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b678e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c424f expref: 16 pid: 6528 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583104.007270:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:0.0:1787583104.007280:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:2406:x1874416413753600:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583104.007304:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583104.007311:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b678e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c424f expref: 16 pid: 6528 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.007323:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b678e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c424f expref: 16 pid: 6528 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.007345:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b678e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c424f expref: 16 pid: 6528 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.007360:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:0.0:1787583104.007365:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.007384:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.007390:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.007417:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583104.007464:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:2406:x1874416413753600:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 185us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583104.007472:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00010000:00010000:1.0:1787583104.007717:0:7748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.007729:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.007768:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.007775:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.007782:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.007787:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.007792:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.007800:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.007809:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:1.0:1787583104.007811:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787583104.007814:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.007831:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b67d4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583104.007907:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:11311:x1874416413753472:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 5833us (6011us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787583104.007914:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:3.0:1787583104.015162:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583104.015522:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413753728 00000100:00100000:0.0:1787583104.015532:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413753728 00000100:00100000:0.0:1787583104.015589:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1787583104.015599:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413753728:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787583104.015639:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.015669:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c426b expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.015678:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583104.015683:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583104.015688:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.015730:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c426b expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.015764:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c426b expref: 7 pid: 8442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583104.015779:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8445:1874416435855872:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583104.015873:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b37c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787583104.020887:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583104.020930:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413753856 00000100:00100000:0.0:1787583104.020940:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413753856 00010000:00010000:0.0:1787583104.020977:0:13742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c426b expref: 8 pid: 8442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583104.021017:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:0.0:1787583104.021027:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2407:x1874416413753856:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583104.021041:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583104.021062:0:13742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c426b expref: 8 pid: 8442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.021075:0:13742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c426b expref: 8 pid: 8442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.021102:0:13742:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583104.021107:0:13742:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583104.021113:0:13742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.021137:0:13742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.021159:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583104.021218:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2407:x1874416413753856:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 193us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583104.021226:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00010000:00010000:3.0:1787583104.022164:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b67bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c426b expref: 7 pid: 8442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583104.022181:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8445:1874416435855872:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583104.022996:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.023013:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.023021:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.023050:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.023058:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.023066:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.023073:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583104.023084:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.023092:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.023111:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.023118:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b67db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583104.023218:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413753728:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 7618us (8062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583104.023228:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1787583104.025703:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583104.025936:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413754112 00000100:00100000:2.0:1787583104.025945:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413754112 00000100:00100000:2.0:1787583104.026082:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:2.0:1787583104.026091:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:11311:x1874416413754112:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787583104.026168:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.026184:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6622 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41f4 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.026219:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.026253:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41f4 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.026266:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6622 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41f4 expref: 14 pid: 6528 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583104.026281:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435856000:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583104.026405:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092476906c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583104.030278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583104.030311:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413754240 00000100:00100000:0.0:1787583104.030323:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413754240 00010000:00010000:0.0:1787583104.030356:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6622 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41f4 expref: 15 pid: 6528 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583104.030359:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435856000:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583104.030398:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:0.0:1787583104.030407:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093770b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:2407:x1874416413754240:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583104.030419:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583104.030426:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6622 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41f4 expref: 15 pid: 6528 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.030437:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41f4 expref: 15 pid: 6528 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.030441:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.030478:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6622 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c41f4 expref: 15 pid: 6528 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.030523:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583104.030529:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.030538:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.030546:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.030578:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583104.030634:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093770b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:2407:x1874416413754240:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 227us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583104.030649:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00010000:00010000:2.0:1787583104.031888:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.031899:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.032081:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.032109:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b679c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4256 expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.032118:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.032160:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b679c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4256 expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.032176:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b679c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4256 expref: 14 pid: 6527 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583104.032193:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435856128:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583104.032519:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247690900 going to sleep for 11 seconds 00000100:00100000:3.0:1787583104.037605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583104.037639:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413754368 00000100:00100000:3.0:1787583104.037647:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413754368 00010000:00010000:3.0:1787583104.037684:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b679c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4256 expref: 15 pid: 6527 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583104.037732:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:3.0:1787583104.037745:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:2406:x1874416413754368:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583104.037759:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583104.037766:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b679c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4256 expref: 15 pid: 6527 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.037792:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b679c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4256 expref: 15 pid: 6527 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.037823:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:3.0:1787583104.037828:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.037837:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.038104:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.038124:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583104.038170:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:2406:x1874416413754368:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 429us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583104.038178:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00010000:00010000:2.0:1787583104.039066:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b679c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4256 expref: 14 pid: 6527 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583104.039091:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435856128:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583104.039122:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.039131:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.039136:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787583104.039265:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1787583104.039386:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1787583104.039415:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1787583104.039483:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6529:1874416435856256:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787583104.039547:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583104.039582:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092476900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583104.039605:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435856256 00000100:00100000:3.0:1787583104.039615:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435856256 00000100:00100000:3.0:1787583104.039663:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787583104.039672:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6529:x1874416435856256:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787583104.039753:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6529:x1874416435856256:12345-0@lo:1000:mdt00_002.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583104.039760:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787583104.041618:0:6529:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787583104.041626:0:6529:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff909247ec9180, transno 4294967304 00000100:00100000:2.0:1787583104.041650:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6529:1874416435856256:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787583104.041796:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1787583104.041892:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6529:1874416435856384:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787583104.041950:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583104.041978:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247690e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787583104.041998:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435856384 00000100:00100000:2.0:1787583104.042003:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435856384 00000100:00100000:2.0:1787583104.042041:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787583104.042050:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6529:x1874416435856384:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787583104.042195:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6529:x1874416435856384:12345-0@lo:1000:mdt00_002.0 Request processed in 143us (243us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787583104.042203:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787583104.042375:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6529:1874416435856384:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787583104.042414:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042425:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042432:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042440:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583104.042445:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042453:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042476:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:2.0:1787583104.042479:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787583104.042484:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042490:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67e9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042530:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6717 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042537:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6717 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042543:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6717 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042548:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583104.042551:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6717 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042557:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6717 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042564:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:2.0:1787583104.042567:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787583104.042570:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6717 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042576:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6717 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042620:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042633:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c423a expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042641:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042661:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c423a expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.042673:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c423a expref: 17 pid: 6529 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583104.042684:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fdb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435856512:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583104.042741:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247690e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787583104.052812:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fdb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435856512:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583104.052841:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583104.053162:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583104.053217:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413754496 00000100:00100000:0.0:1787583104.053224:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413754496 00010000:00010000:0.0:1787583104.053265:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c423a expref: 18 pid: 6529 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583104.053309:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:0.0:1787583104.053319:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:2407:x1874416413754496:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583104.053333:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583104.053340:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c423a expref: 18 pid: 6529 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.053361:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c423a expref: 18 pid: 6529 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.053392:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6733 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c423a expref: 18 pid: 6529 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.053407:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:0.0:1787583104.053411:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.053421:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.053429:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.053452:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583104.053510:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+17:2407:x1874416413754496:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 182us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583104.053518:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00010000:00010000:1.0:1787583104.053723:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053733:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053745:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053752:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053758:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053764:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.053768:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053775:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053786:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:1.0:1787583104.053789:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583104.053799:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053806:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b67f0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053820:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053836:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053842:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053869:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480a00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.053877:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053884:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053893:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90937e013f00) 00010000:00010000:1.0:1787583104.053895:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787583104.053898:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.053909:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b67e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583104.054060:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:11311:x1874416413754112:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 27968us (28364us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787583104.054070:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 93 00000020:00080000:1.0:1787583104.054082:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787583104.054676:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787583104.054681:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787583104.054699:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787583104.054707:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787583104.060491:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583104.060715:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413754752 00000100:00100000:0.0:1787583104.060724:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413754752 00000100:00100000:0.0:1787583104.060780:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1787583104.060802:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:11311:x1874416413754752:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787583104.061103:0:6530:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787583104.061136:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1787583104.061168:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b67f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.061184:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b67f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.061195:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b67f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.061202:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b67f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.061209:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b67f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.061216:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b67f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.061239:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787583104.062942:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787583104.062953:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b67f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.062964:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787583104.062968:0:7469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b67f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.062977:0:7469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b67f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.062995:0:7469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:1.0:1787583104.062999:0:7469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787583104.063003:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b67f7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.063010:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b67f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.063023:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583104.063026:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583104.063028:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583104.064539:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:11311:x1874416413754752:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 3741us (4049us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787583104.064551:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000020:00080000:0.0:1787583104.064558:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1787583104.067577:0:14219:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787583104.067586:0:14219:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787583104.072732:0:14219:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787583104.072744:0:14219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787583104.215924:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583104.216890:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413755008 00000100:00100000:2.0:1787583104.216902:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413755008 00000100:00100000:2.0:1787583104.216971:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:2.0:1787583104.216983:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:11321:x1874416413755008:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583104.217005:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583104.217024:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4272 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.217121:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b6805 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.217142:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b6805 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.217154:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b6805 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583104.217165:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787583104.217272:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b67fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4272 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.217290:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b6805 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4272 expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.217298:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:2.0:1787583104.217302:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787583104.217305:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480000, rc 0) 00000100:00100000:2.0:1787583104.217613:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:11321:x1874416413755008:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 387us (1452us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787583104.217620:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:2.0:1787583104.220731:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.220805:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413755136 00000100:00100000:1.0:1787583104.220814:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413755136 00000100:00100000:1.0:1787583104.220888:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:1.0:1787583104.220898:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:11321:x1874416413755136:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:1.0:1787583104.220979:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6813 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.220994:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6813 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221005:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6813 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221018:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b681a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221025:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b681a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221032:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b681a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221105:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6821 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221112:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221118:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583104.221159:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221172:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6813 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221189:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6813 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221197:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6813 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221204:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52c00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.221208:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6813 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221215:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6813 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221227:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:1.0:1787583104.221230:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583104.221234:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6813 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221248:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6813 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221259:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b681a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221265:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b681a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221271:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b681a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221275:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.221282:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b681a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221289:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b681a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221296:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909342920100) 00010000:00010000:1.0:1787583104.221298:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583104.221301:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b681a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221306:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b681a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221319:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221324:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6821 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221330:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6821 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221335:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.221338:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6821 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221343:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6821 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221349:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920700) 00010000:00010000:1.0:1787583104.221351:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583104.221357:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6821 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.221362:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6821 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583104.222052:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:11321:x1874416413755136:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 1153us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583104.222061:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:3.0:1787583104.280716:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.280945:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413755392 00000100:00100000:1.0:1787583104.280955:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413755392 00000100:00100000:1.0:1787583104.281016:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:1.0:1787583104.281027:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:11324:x1874416413755392:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1787583104.281046:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583104.281065:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6828 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4279 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281131:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b682f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281144:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b682f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281154:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b682f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281168:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6836 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281175:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281197:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281314:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b683d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281322:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b683d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281329:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b683d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583104.281338:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787583104.281414:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b682f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281421:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b682f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281427:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b682f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281433:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.281437:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b682f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281444:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b682f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281455:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:1.0:1787583104.281458:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583104.281468:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b682f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281474:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b682f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281486:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281492:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6836 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281507:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281513:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52c00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.281516:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281521:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6836 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281530:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909342920700) 00010000:00010000:1.0:1787583104.281532:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583104.281535:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6836 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.281540:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6836 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.282143:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6828 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4279 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.282174:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b683d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4279 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.282182:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:1.0:1787583104.282185:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787583104.282187:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52600, rc 0) 00000100:00100000:1.0:1787583104.282978:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:11324:x1874416413755392:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1946us (2265us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787583104.282988:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:3.0:1787583104.298559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583104.298754:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413755520 00000100:00100000:2.0:1787583104.298764:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413755520 00000100:00100000:2.0:1787583104.298823:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:2.0:1787583104.298833:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:11324:x1874416413755520:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1787583104.298937:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b684b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.298959:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b684b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.299098:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b684b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.299139:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b684b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.299145:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b684b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.299152:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b684b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.299158:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583104.299162:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b684b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.299169:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b684b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.299182:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:2.0:1787583104.299185:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787583104.299189:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b684b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.299196:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b684b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583104.299378:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:11324:x1874416413755520:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 545us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583104.299386:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:0.0:1787583104.339833:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583104.340493:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413755776 00000100:00100000:2.0:1787583104.340524:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413755776 00000100:00100000:2.0:1787583104.340573:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1787583104.340583:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373fa5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:11324:x1874416413755776:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1787583104.341066:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373fa5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:11324:x1874416413755776:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 483us (1240us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1787583104.341075:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00010000:00010000:2.0:1787583104.398158:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583104.403433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.403570:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413756032 00000100:00100000:1.0:1787583104.403579:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413756032 00000100:00100000:1.0:1787583104.403639:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:1.0:1787583104.403650:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:10852:x1874416413756032:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1787583104.403672:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583104.403692:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6852 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4280 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.403806:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.403819:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b683d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4279 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.403828:0:7748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.403889:0:7748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b683d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4279 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.403916:0:7748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b683d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4279 expref: 24 pid: 6529 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583104.403930:0:7748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352913800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435856640:192.168.203.11@tcp:104: 00000100:00100000:1.0:1787583104.404180:0:7748:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91840 going to sleep for 11 seconds 00000100:00100000:1.0:1787583104.406450:0:7748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352913800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435856640:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583104.406475:0:7748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583104.410226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583104.411728:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413756160 00000100:00100000:2.0:1787583104.411741:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413756160 00010000:00010000:2.0:1787583104.411790:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b683d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4279 expref: 25 pid: 6529 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583104.411828:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1787583104.411840:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+25:2407:x1874416413756160:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583104.411886:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583104.411893:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b683d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4279 expref: 25 pid: 6529 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.411907:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b683d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4279 expref: 25 pid: 6529 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.411929:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b683d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4279 expref: 25 pid: 6529 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.411946:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:2.0:1787583104.411952:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.411994:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.412002:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.412034:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583104.412087:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:2407:x1874416413756160:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 248us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583104.412095:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00010000:00010000:1.0:1787583104.412292:0:7748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.412301:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583104.412320:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787583104.412442:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6852 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4280 expref: 25 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.412457:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4280 expref: 24 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.412465:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:1.0:1787583104.412468:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787583104.412470:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52c00, rc 0) 00000100:00100000:1.0:1787583104.412495:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:10852:x1874416413756032:12345-192.168.203.11@tcp:101:bash.0 Request processed in 8847us (9072us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1787583104.412522:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:0.0:1787583104.419122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.419436:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413756288 00000100:00100000:1.0:1787583104.419446:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413756288 00000100:00100000:0.0:1787583104.419675:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:0.0:1787583104.419700:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:10852:x1874416413756288:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1787583104.419738:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583104.419758:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6867 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4287 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.419801:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b686e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.419813:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b686e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.419824:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b686e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.419978:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6867 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4287 expref: 26 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.419996:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b686e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4287 expref: 25 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.420005:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:0.0:1787583104.420008:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787583104.420011:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e800, rc 0) 00000100:00100000:0.0:1787583104.420073:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+25:10852:x1874416413756288:12345-192.168.203.11@tcp:101:bash.0 Request processed in 376us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583104.420080:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:1.0:1787583104.423132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583104.423248:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413756544 00000100:00100000:3.0:1787583104.423258:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413756544 00000100:00100000:3.0:1787583104.423304:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:3.0:1787583104.423311:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+25:10852:x1874416413756544:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:3.0:1787583104.423496:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6875 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.423520:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.423531:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787583104.423583:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1787583104.423604:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cd3ef38 reply state 00000000dfd0d59e transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.423618:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6875 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.424054:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:3.0:1787583104.424059:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787583104.424064:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787583104.424117:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1787583104.424315:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:10852:x1874416413756544:12345-192.168.203.11@tcp:36:bash.0 Request processed in 1001us (1185us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787583104.424323:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 100 00000020:00080000:3.0:1787583104.424328:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787583104.426233:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.426383:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413756672 00000100:00100000:1.0:1787583104.426392:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413756672 00000100:00100000:1.0:1787583104.426444:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:1.0:1787583104.426456:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:10852:x1874416413756672:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1787583104.426477:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583104.426493:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b687c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c428e expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.426553:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b687c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c428e expref: 30 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.426562:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b687c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c428e expref: 30 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.426575:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:1.0:1787583104.426577:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787583104.426580:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53c00, rc 0) 00000100:00100000:1.0:1787583104.426633:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+30:10852:x1874416413756672:12345-192.168.203.11@tcp:101:bash.0 Request processed in 180us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583104.426640:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:1.0:1787583104.429115:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583104.429210:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413756800 00000100:00100000:2.0:1787583104.429221:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413756800 00000100:00100000:2.0:1787583104.429323:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:2.0:1787583104.429332:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:10852:x1874416413756800:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1787583104.429350:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583104.429370:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b6883 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4295 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787583104.429394:0:8444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c5a7d, atime: 0x6a8c5a7c, ctime: 0x6a8c5a7d, blocks: 0x8 00010000:00010000:2.0:1787583104.429417:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1787583104.429422:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583104.429430:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b6883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4295 expref: 7 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.429446:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b6883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4295 expref: 7 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583104.429480:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481400, rc 0) 00000100:00100000:2.0:1787583104.429554:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:10852:x1874416413756800:12345-192.168.203.11@tcp:101:bash.0 Request processed in 223us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583104.429561:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1787583104.434423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.434559:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413756928 00000100:00100000:1.0:1787583104.434568:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413756928 00002000:00010000:1.0:1787583104.434626:0:8448:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1787583104.434631:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90937fc61f80 with x1874416413756928 ext(0->18446744073709551615) 00002000:00010000:1.0:1787583104.434643:0:8448:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90937fc61f80. 00000100:00100000:1.0:1787583104.434677:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:1.0:1787583104.434688:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413756928:12345-192.168.203.11@tcp:10:bash.0 00002000:00010000:1.0:1787583104.435017:0:8448:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787583104.435021:0:8448:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787583101 -> 1787583103 00002000:00010000:1.0:1787583104.435024:0:8448:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787583100 -> 1787583100 00002000:00010000:1.0:1787583104.435026:0:8448:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787583101 -> 1787583103 00002000:00010000:1.0:1787583104.435028:0:8448:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787583104.435088:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2406:x1874416413756928:12345-192.168.203.11@tcp:10:bash.0 Request processed in 401us (671us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787583104.435095:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00002000:00010000:1.0:1787583104.435099:0:8448:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1787583104.435101:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90937fc61f80 with x1874416413756928 ext(0->18446744073709551615) 00002000:00010000:1.0:1787583104.435106:0:8448:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90937fc61f80. 00000100:00100000:0.0:1787583104.515215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.515313:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413757056 00000100:00100000:1.0:1787583104.515323:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413757056 00000100:00100000:1.0:1787583104.515384:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:1.0:1787583104.515395:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+30:11339:x1874416413757056:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:1.0:1787583104.515473:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b688a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515489:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b688a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515509:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b688a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515544:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6891 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515551:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515559:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515630:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6898 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515639:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515646:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583104.515700:0:13828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515710:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b688a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515729:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b688a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515736:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b688a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515741:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.515745:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b688a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515758:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b688a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515770:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:1.0:1787583104.515772:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583104.515776:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b688a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515782:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b688a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515804:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515810:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6891 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515815:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6891 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515823:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52a00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.515825:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6891 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515830:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6891 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515836:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909342920700) 00010000:00010000:1.0:1787583104.515838:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583104.515840:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6891 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515913:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6891 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515928:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515933:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6898 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515939:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515944:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.515947:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515953:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6898 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515960:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:1.0:1787583104.515962:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583104.515965:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6898 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.515970:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6898 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583104.516040:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+30:11339:x1874416413757056:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 646us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583104.516048:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:2.0:1787583104.564097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583104.564576:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413757312 00000100:00100000:3.0:1787583104.564585:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413757312 00000100:00100000:3.0:1787583104.564655:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:3.0:1787583104.564665:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+30:11342:x1874416413757312:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1787583104.564683:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583104.564701:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b689f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c429c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.564983:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.564998:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565009:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565024:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565031:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565037:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565141:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b68b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565150:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b68b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565157:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b68b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583104.565188:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787583104.565618:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565627:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565633:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565639:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583104.565643:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565650:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565662:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:3.0:1787583104.565665:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583104.565669:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565675:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565687:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565693:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565978:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565985:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583104.565988:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.565995:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.566004:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909351203e00) 00010000:00010000:3.0:1787583104.566006:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583104.566009:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.566015:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.566057:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b689f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c429c expref: 33 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.566071:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b68b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c429c expref: 32 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.566078:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:3.0:1787583104.566080:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787583104.566083:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367f400, rc 0) 00000100:00100000:3.0:1787583104.566144:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:11342:x1874416413757312:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1481us (2054us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787583104.566160:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:2.0:1787583104.570150:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.570284:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413757440 00000100:00100000:1.0:1787583104.570294:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413757440 00000100:00100000:1.0:1787583104.570360:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:1.0:1787583104.570370:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:11342:x1874416413757440:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:1.0:1787583104.570427:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.570444:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4280 expref: 32 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.570454:0:7748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.570487:0:7748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4280 expref: 32 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.570511:0:7748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4280 expref: 32 pid: 7748 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583104.570525:0:7748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245ae4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435856768:192.168.203.11@tcp:104: 00000100:00100000:1.0:1787583104.570605:0:7748:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583104.574625:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.574766:0:7748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245ae4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435856768:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583104.574799:0:7748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583104.574807:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413757696 00000100:00100000:2.0:1787583104.574814:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413757696 00000100:00100000:2.0:1787583104.574894:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:2.0:1787583104.574904:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+33:6176:x1874416413757696:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787583104.575458:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+34:6176:x1874416413757696:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 554us (840us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787583104.575467:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1787583104.579642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583104.579722:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413757824 00000100:00100000:3.0:1787583104.579731:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413757824 00010000:00010000:3.0:1787583104.579781:0:13742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4280 expref: 34 pid: 7748 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583104.580109:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1787583104.580119:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+34:2407:x1874416413757824:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583104.580135:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583104.580143:0:13742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4280 expref: 34 pid: 7748 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.580156:0:13742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4280 expref: 34 pid: 7748 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.580178:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6859 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4280 expref: 34 pid: 7748 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.580194:0:13742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:3.0:1787583104.580200:0:13742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.580209:0:13742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.580216:0:13742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.580265:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583104.580325:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+33:2407:x1874416413757824:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 207us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583104.580332:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00010000:00010000:1.0:1787583104.580434:0:7748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.580443:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.580490:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.580508:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.580516:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.580521:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.580525:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.580533:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.580543:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:1.0:1787583104.580546:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787583104.580549:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.580555:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b68c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583104.580589:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:11342:x1874416413757440:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 10221us (10447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583104.580597:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:0.0:1787583104.587118:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.587212:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413758080 00000100:00100000:1.0:1787583104.587222:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413758080 00000100:00100000:1.0:1787583104.587279:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:1.0:1787583104.587300:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:11342:x1874416413758080:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1787583104.587543:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+33:11342:x1874416413758080:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 245us (433us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787583104.587551:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:2.0:1787583104.693835:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583104.693970:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413758336 00000100:00100000:0.0:1787583104.693980:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413758336 00000100:00100000:0.0:1787583104.694037:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:0.0:1787583104.694046:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+33:11353:x1874416413758336:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:0.0:1787583104.694068:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583104.694086:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b68c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42a3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694163:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b68d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694182:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b68d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694193:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b68d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694207:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b68d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694214:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b68d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694221:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b68d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694330:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b68de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694339:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b68de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694359:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b68de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583104.694369:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1787583104.694435:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b68d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694442:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b68d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694449:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b68d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694455:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583104.694459:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b68d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694465:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b68d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694476:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583104.694479:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583104.694482:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b68d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694488:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b68d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694510:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b68d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694516:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b68d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694527:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b68d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694533:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583104.694536:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b68d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694541:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b68d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694549:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90937e013b00) 00010000:00010000:0.0:1787583104.694551:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583104.694554:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b68d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694560:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b68d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694594:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b68c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42a3 expref: 36 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694606:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b68de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42a3 expref: 35 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.694613:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:0.0:1787583104.694615:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787583104.694617:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713ec00, rc 0) 00000100:00100000:0.0:1787583104.694720:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+35:11353:x1874416413758336:12345-192.168.203.11@tcp:101:cat.0 Request processed in 673us (898us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787583104.694736:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:0.0:1787583104.700684:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.700916:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413758592 00000100:00100000:1.0:1787583104.700926:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413758592 00000100:00100000:1.0:1787583104.700994:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:1.0:1787583104.701004:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+35:11353:x1874416413758592:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:1.0:1787583104.701320:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+36:11353:x1874416413758592:12345-192.168.203.11@tcp:35:cat.0 Request processed in 317us (649us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787583104.701328:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1787583104.726251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583104.726338:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413758848 00000100:00100000:3.0:1787583104.726348:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413758848 00000100:00100000:3.0:1787583104.726444:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:3.0:1787583104.726455:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+36:11354:x1874416413758848:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1787583104.726521:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1787583104.726549:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53c00/0x19a47956376b687c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c428e expref: 36 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.726569:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b68de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42a3 expref: 35 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.726581:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b68b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c429c expref: 34 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.726594:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b686e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4287 expref: 33 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.726603:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:3.0:1787583104.726608:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787583104.726626:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b68ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.726638:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b68ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.726660:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b68ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.726676:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.726683:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.726689:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.726767:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.726787:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.726794:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787583104.727120:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00010000:00010000:3.0:1787583104.727169:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6901 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727178:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727185:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727192:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6901 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727206:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6901 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727212:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6901 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727234:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787583104.727255:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727261:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68fa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727266:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727271:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583104.727276:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727283:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68fa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727292:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:3.0:1787583104.727295:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787583104.727298:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68fa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727304:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b68fa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727319:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b68ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727333:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b68ec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727339:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b68ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727344:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583104.727347:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b68ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727352:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b68ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727360:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:3.0:1787583104.727362:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583104.727364:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b68ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727369:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b68ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787583104.727379:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036aad81c reply state 00000000841c86ba transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727389:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.727394:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909351203e00) 00010000:00010000:3.0:1787583104.727396:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787583104.727398:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787583104.728520:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583104.728605:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6901 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.728612:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344deda00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583104.728616:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6901 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.728622:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6901 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.728635:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:0.0:1787583104.728637:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787583104.728641:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6901 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.728647:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6901 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.728661:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583104.728663:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583104.728665:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583104.729840:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+34:11354:x1874416413758848:12345-192.168.203.11@tcp:36:rm.0 Request processed in 3378us (3590us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787583104.729890:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:0.0:1787583104.775964:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583104.776659:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413759104 00000100:00100000:1.0:1787583104.776670:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413759104 00000100:00100000:1.0:1787583104.776792:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:1.0:1787583104.776805:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+34:11360:x1874416413759104:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1787583104.776829:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583104.776888:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6908 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42aa expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.776991:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b690f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.777005:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b690f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.777016:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b690f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.777048:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6916 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.777056:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6916 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.777063:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6916 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787583104.777379:0:7748:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787583104.778349:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b691d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778364:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b691d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778373:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b691d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778410:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b690f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778418:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b690f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778425:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b690f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778431:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583104.778435:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b690f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778456:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b690f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778469:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:1.0:1787583104.778472:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583104.778476:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b690f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778483:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b690f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583104.778510:0:7748:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b34ace5f reply state 0000000080b4fa0d transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6916 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778521:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6916 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778527:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909351203e00) 00010000:00010000:1.0:1787583104.778529:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787583104.778532:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787583104.778564:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6908 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42aa expref: 37 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778578:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b691d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42aa expref: 36 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583104.778585:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920700) 00010000:00010000:1.0:1787583104.778588:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787583104.778590:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53200, rc 0) 00000100:00100000:1.0:1787583104.778654:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+37:11360:x1874416413759104:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1852us (2711us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787583104.778667:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:1.0:1787583104.782624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583104.782696:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413759232 00000100:00100000:3.0:1787583104.782707:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413759232 00000100:00100000:3.0:1787583104.782816:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:3.0:1787583104.782842:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413759232:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1787583104.782879:0:8752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583104.782900:0:8752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b302898/0x19a47956376b692b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42b1 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787583104.782926:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583104.782944:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:3.0:1787583104.782949:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583104.782958:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b302898/0x19a47956376b692b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b1 expref: 8 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.782974:0:8752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b302898/0x19a47956376b692b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b1 expref: 8 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.782987:0:8752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344decc00, rc 0) 00000100:00100000:3.0:1787583104.783046:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2406:x1874416413759232:12345-192.168.203.11@tcp:101:bash.0 Request processed in 220us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583104.783053:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00080000:2.0:1787583104.783116:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583104.790619:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583104.790816:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413759360 00000100:00100000:3.0:1787583104.791321:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413759360 00000100:00100000:3.0:1787583104.791385:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1787583104.791396:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:11360:x1874416413759360:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1787583104.791429:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583104.791447:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42b8 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.791479:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b302898/0x19a47956376b692b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b1 expref: 9 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.791488:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583104.791493:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583104.791509:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 9 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.791547:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b302898/0x19a47956376b692b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b1 expref: 9 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.791562:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b302898/0x19a47956376b692b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b1 expref: 9 pid: 8752 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583104.791577:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8442:1874416435856896:192.168.203.11@tcp:104: 00000100:00100000:3.0:1787583104.791723:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b0c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583104.795630:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583104.796011:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8442:1874416435856896:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583104.796042:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 9 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583104.796062:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dede00, rc 0) 00000100:00100000:3.0:1787583104.796139:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:11360:x1874416413759360:12345-192.168.203.11@tcp:101:bash.0 Request processed in 4744us (5529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583104.796147:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:0.0:1787583104.796257:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413759488 00000100:00100000:0.0:1787583104.796266:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413759488 00010000:00010000:0.0:1787583104.796300:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b302898/0x19a47956376b692b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b1 expref: 9 pid: 8752 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583104.797026:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1787583104.797038:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413759488:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583104.797052:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583104.797071:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b302898/0x19a47956376b692b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b1 expref: 9 pid: 8752 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.797086:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b302898/0x19a47956376b692b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b1 expref: 9 pid: 8752 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.797109:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b302898/0x19a47956376b692b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b1 expref: 9 pid: 8752 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.797125:0:6512:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583104.797130:0:6512:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583104.797138:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.797148:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583104.797180:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583104.797194:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6512:1874416435857024:192.168.203.11@tcp:105: 00000100:00100000:0.0:1787583104.797272:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b37900 going to sleep for 11 seconds 00000100:00100000:0.0:1787583104.802565:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6512:1874416435857024:192.168.203.11@tcp:105: 00010000:00010000:0.0:1787583104.802591:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583104.802651:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2407:x1874416413759488:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 5615us (7030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583104.802662:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:1.0:1787583104.803266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583104.803492:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413759744 00000100:00100000:2.0:1787583104.803510:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413759744 00000100:00100000:2.0:1787583104.803594:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1787583104.803604:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+37:11360:x1874416413759744:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1787583104.803901:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:11360:x1874416413759744:12345-192.168.203.11@tcp:35:bash.0 Request processed in 297us (635us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787583104.803908:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1787583105.028311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583105.028404:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413759872 00000100:00100000:0.0:1787583105.028414:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413759872 00000100:00100000:0.0:1787583105.028505:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:0.0:1787583105.028528:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:11376:x1874416413759872:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583105.028553:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583105.028574:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.028638:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6940 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.028650:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.028662:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583105.028710:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787583105.028714:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583105.028732:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.028754:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42bf expref: 40 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.028800:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6940 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42bf expref: 39 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.028817:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583105.028820:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583105.028823:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fa00, rc 0) 00000100:00100000:0.0:1787583105.028931:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+39:11376:x1874416413759872:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 417us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583105.028939:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00080000:2.0:1787583105.029622:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787583105.039183:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.039348:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413760128 00000100:00100000:2.0:1787583105.039357:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413760128 00000100:00100000:2.0:1787583105.039418:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00100000:2.0:1787583105.039429:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+39:11376:x1874416413760128:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583105.039449:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583105.039468:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6947 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42c6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.039596:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b694e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.039610:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b694e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.039621:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b694e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583105.039633:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787583105.039746:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6947 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42c6 expref: 42 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.039766:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b694e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42c6 expref: 41 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.039774:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920700) 00010000:00010000:2.0:1787583105.039777:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583105.039780:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481600, rc 0) 00000100:00100000:2.0:1787583105.040156:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+41:11376:x1874416413760128:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 726us (980us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1787583105.040178:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00100000:2.0:1787583105.068944:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.068994:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583105.069032:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413760384 00000100:00100000:1.0:1787583105.069044:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413760384 00000100:00100000:1.0:1787583105.069114:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 110 00000100:00100000:1.0:1787583105.069125:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+41:11376:x1874416413760384:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1787583105.069150:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583105.069170:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b695c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42cd expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.069275:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6963 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.069303:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6963 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.069314:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6963 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583105.069326:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787583105.069428:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b695c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42cd expref: 44 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.069446:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6963 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42cd expref: 43 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.069455:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920700) 00010000:00010000:1.0:1787583105.069475:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787583105.069478:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52800, rc 0) 00000100:00100000:1.0:1787583105.070400:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:11376:x1874416413760384:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1272us (1461us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1787583105.070411:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 110 00000100:00100000:3.0:1787583105.077193:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413760512 00000100:00100000:3.0:1787583105.077208:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413760512 00000100:00100000:2.0:1787583105.077459:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1787583105.077471:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:2404:x1874416413760512:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583105.077489:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583105.077530:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b694e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42c6 expref: 43 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.077552:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920700) 00010000:00010000:2.0:1787583105.077556:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583105.077611:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+42:2404:x1874416413760512:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 142us (8616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583105.077618:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1787583105.081877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583105.082149:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413760640 00000100:00100000:1.0:1787583105.082159:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413760640 00000100:00100000:1.0:1787583105.082272:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:1.0:1787583105.082407:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2406:x1874416413760640:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:1.0:1787583105.082454:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.082474:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.082483:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787583105.082488:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787583105.082504:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.082594:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.082609:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 8 pid: 8442 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583105.082625:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8445:1874416435857152:192.168.203.11@tcp:104: 00000100:00100000:1.0:1787583105.084470:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c913c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583105.097428:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.097551:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413760768 00000100:00100000:2.0:1787583105.097561:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413760768 00002000:00100000:2.0:1787583105.097615:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff90937fce9880 x1874416413760768/t0(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:571/0 lens 504/0 e 0 to 0 dl 1787583116 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787583105.097626:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90937fce9880 with x1874416413760768 ext(0->8) 00010000:00010000:2.0:1787583105.097636:0:8450:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 9 pid: 8442 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.097655:0:8450:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 9 pid: 8442 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787583105.097686:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90937fce9880 00000100:00100000:2.0:1787583105.097735:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1787583105.097746:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2406:x1874416413760768:12345-192.168.203.11@tcp:4:lfs.0 00000100:00100000:2.0:1787583105.098679:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:2406:x1874416413760768:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 928us (1253us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787583105.098690:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00002000:00100000:2.0:1787583105.098699:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff90937fce9880 x1874416413760768/t4294967303(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:571/0 lens 504/448 e 0 to 0 dl 1787583116 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787583105.098708:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90937fce9880 with x1874416413760768 ext(0->8) 00010000:00010000:2.0:1787583105.098716:0:8450:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 11 pid: 8442 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.098729:0:8450:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 11 pid: 8442 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787583105.098736:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90937fce9880 00000100:00100000:1.0:1787583105.104013:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8445:1874416435857152:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583105.104043:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583105.109823:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583105.110425:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413760896 00000100:00100000:0.0:1787583105.110436:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413760896 00010000:00010000:0.0:1787583105.110480:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 11 pid: 8442 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583105.110563:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:0.0:1787583105.110574:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093770b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:2405:x1874416413760896:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583105.110591:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787583105.110609:0:6513:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787583105.110612:0:6513:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787583103 00002000:00010000:0.0:1787583105.110615:0:6513:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787583103 00002000:00010000:0.0:1787583105.110617:0:6513:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787583103 00002000:00010000:0.0:1787583105.110619:0:6513:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787583105.110626:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 11 pid: 8442 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.110662:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 11 pid: 8442 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.110687:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd55842b/0x19a47956376b6932 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42b8 expref: 11 pid: 8442 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.110704:0:6513:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583105.110825:0:6513:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583105.110831:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.110841:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.111009:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583105.111066:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093770b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:2405:x1874416413760896:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 493us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583105.111074:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00010000:00010000:3.0:1787583105.113200:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.113217:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.113258:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.113267:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.113275:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.113282:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52a00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583105.113287:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.113296:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.113340:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.113348:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4de79d9/0x19a47956376b6971 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583105.113488:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2406:x1874416413760640:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 31203us (31647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583105.113508:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:2.0:1787583105.117181:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583105.117315:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413761152 00000100:00100000:0.0:1787583105.117324:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413761152 00000100:00100000:0.0:1787583105.117377:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1787583105.117395:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373fa4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+42:11376:x1874416413761152:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:0.0:1787583105.117458:0:6530:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6963 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42cd expref: 42 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787583105.117682:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1787583105.117726:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787583105.118593:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1787583105.118638:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.118654:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b691d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42aa expref: 46 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.118662:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.118697:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b691d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42aa expref: 46 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.119003:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b691d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42aa expref: 46 pid: 7748 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583105.119020:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6530:1874416435857280:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583105.119161:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b37000 going to sleep for 11 seconds 00000100:00100000:0.0:1787583105.122934:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583105.122991:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413761280 00000100:00100000:3.0:1787583105.123001:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413761280 00010000:00010000:3.0:1787583105.123041:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b691d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42aa expref: 47 pid: 7748 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583105.123229:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1787583105.123241:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+47:2407:x1874416413761280:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583105.123257:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583105.123265:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b691d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42aa expref: 47 pid: 7748 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.123279:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b691d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42aa expref: 47 pid: 7748 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.123301:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920700) 00010000:00010000:3.0:1787583105.123307:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.123331:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.123339:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.123358:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583105.123429:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+47:2407:x1874416413761280:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 190us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583105.123436:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00010000:00010000:2.0:1787583105.124131:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b691d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42aa expref: 46 pid: 7748 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583105.124149:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6530:1874416435857280:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583105.124172:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.124189:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.124196:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787583105.124377:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1787583105.124484:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1787583105.124586:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e34380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6530:1874416435857408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787583105.124635:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583105.124663:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583105.125027:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435857408 00000100:00100000:3.0:1787583105.125033:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435857408 00000100:00100000:3.0:1787583105.125093:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787583105.125102:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6530:x1874416435857408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1787583105.125543:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583105.125622:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6530:x1874416435857408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 519us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583105.125630:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787583105.127069:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e34380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6530:1874416435857408:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787583105.127940:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1787583105.128025:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6530:1874416435857536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787583105.128081:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583105.128156:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91240 going to sleep for 11 seconds 00000100:00100000:2.0:1787583105.133263:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435857536 00000100:00100000:2.0:1787583105.133278:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435857536 00000100:00100000:2.0:1787583105.133333:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787583105.133343:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6530:x1874416435857536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787583105.133576:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6530:x1874416435857536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 233us (5494us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787583105.133584:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787583105.133765:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6530:1874416435857536:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787583105.133838:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1787583105.133916:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.133927:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.133935:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.133940:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583105.133945:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.133952:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.133985:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920700) 00010000:00010000:1.0:1787583105.133988:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787583105.133993:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.133999:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6978 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787583105.134111:0:6530:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787583105.134172:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787583105.134184:0:6530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 412287338049ns, next at 413287335682ns, rc = 0 00000001:00080000:1.0:1787583105.134190:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1787583105.134211:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920700) 00010000:00010000:1.0:1787583105.134214:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787583105.134221:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6963 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42cd expref: 50 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583105.134317:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373fa4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+49:11376:x1874416413761152:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 16931us (17144us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787583105.134325:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000020:00080000:1.0:1787583105.134328:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787583105.137286:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583105.137354:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413761408 00000100:00100000:1.0:1787583105.137363:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413761408 00000100:00100000:1.0:1787583105.137427:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:1.0:1787583105.137437:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+49:11376:x1874416413761408:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1787583105.137459:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583105.137478:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b697f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42d4 expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.137563:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b697f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42d4 expref: 50 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.137577:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b697f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42d4 expref: 50 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.137595:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:1.0:1787583105.137598:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787583105.137601:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52600, rc 0) 00000100:00100000:1.0:1787583105.137660:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+50:11376:x1874416413761408:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 224us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583105.137667:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:2.0:1787583105.141159:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583105.141258:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413761664 00000100:00100000:1.0:1787583105.141268:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413761664 00000100:00100000:1.0:1787583105.141327:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1787583105.141337:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+50:11376:x1874416413761664:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1787583105.141588:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+51:11376:x1874416413761664:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 252us (438us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787583105.141596:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1787583105.230941:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.232891:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413761792 00000100:00100000:2.0:1787583105.232905:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413761792 00000100:00100000:2.0:1787583105.233052:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:2.0:1787583105.233064:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+51:11386:x1874416413761792:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:2.0:1787583105.233138:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6986 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.233155:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6986 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.233183:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6986 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.233195:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b698d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.233203:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b698d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.233209:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b698d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.234644:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6994 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.234664:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.234674:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787583105.235040:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235054:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6986 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235060:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6986 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235067:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6986 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235091:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583105.235095:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6986 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235102:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6986 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235114:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:2.0:1787583105.235117:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583105.235121:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6986 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235127:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6986 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235141:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b698d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235147:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b698d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235152:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b698d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235158:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583105.235160:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b698d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235166:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b698d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235184:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909351203e00) 00010000:00010000:2.0:1787583105.235186:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583105.235189:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b698d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235196:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b698d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235206:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235212:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6994 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235218:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235294:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583105.235297:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235304:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6994 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235313:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:2.0:1787583105.235316:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583105.235319:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6994 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.235326:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6994 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583105.235421:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+51:11386:x1874416413761792:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 2357us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583105.235452:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:0.0:1787583105.308351:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.308449:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413762048 00000100:00100000:2.0:1787583105.308460:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413762048 00000100:00100000:2.0:1787583105.308540:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:2.0:1787583105.308551:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+51:11389:x1874416413762048:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583105.308572:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583105.308591:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b699b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.308656:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b69a2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.308670:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b69a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.308682:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b69a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.308693:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b69a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.308700:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b69a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.308717:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b69a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.308898:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b69b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.308907:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b69b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.308914:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b69b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583105.308925:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787583105.309006:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b69a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309014:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b69a2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309020:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b69a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309026:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583105.309031:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b69a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309038:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b69a2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309050:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:2.0:1787583105.309054:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583105.309059:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b69a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309076:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b69a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309089:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b69a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309096:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b69a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309101:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b69a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309106:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583105.309109:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b69a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309115:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b69a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309122:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909351203e00) 00010000:00010000:2.0:1787583105.309125:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583105.309128:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b69a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309134:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b69a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309174:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b699b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42db expref: 54 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309188:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b69b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42db expref: 53 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.309203:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:2.0:1787583105.309205:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583105.309209:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480a00, rc 0) 00000100:00100000:2.0:1787583105.309262:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+53:11389:x1874416413762048:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 713us (920us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787583105.309270:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:0.0:1787583105.311971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.313523:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413762176 00000100:00100000:2.0:1787583105.313537:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413762176 00000100:00100000:2.0:1787583105.313671:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:2.0:1787583105.313684:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+53:11389:x1874416413762176:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1787583105.313748:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b69be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.313765:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b69be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.313777:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b69be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.313815:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b69be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.313822:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b69be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.313829:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b69be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.313834:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583105.313871:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b69be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.313879:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b69be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.313891:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:2.0:1787583105.313895:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787583105.313900:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b69be lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.313906:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b69be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583105.313988:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+53:11389:x1874416413762176:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 307us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583105.313997:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:3.0:1787583105.318927:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583105.319219:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413762432 00000100:00100000:1.0:1787583105.319229:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413762432 00000100:00100000:1.0:1787583105.319288:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1787583105.319300:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+53:11389:x1874416413762432:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1787583105.319542:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:11389:x1874416413762432:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 244us (625us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1787583105.319566:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:0.0:1787583105.384170:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.384264:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413762688 00000100:00100000:2.0:1787583105.384275:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413762688 00000100:00100000:2.0:1787583105.384333:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:2.0:1787583105.384345:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:11399:x1874416413762688:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1787583105.384369:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583105.384372:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787583105.384395:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6940 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42bf expref: 54 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.384414:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:2.0:1787583105.384419:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583105.384433:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b69c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42e2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.384579:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.384592:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b69b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42db expref: 54 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.384600:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.384632:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b69b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42db expref: 54 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.384644:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b69b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42db expref: 54 pid: 6529 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583105.384658:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e35180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874416435857664:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583105.384753:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583105.391767:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e35180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874416435857664:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583105.391804:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583105.397368:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583105.397952:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413762816 00000100:00100000:3.0:1787583105.397962:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413762816 00010000:00010000:3.0:1787583105.398003:0:13742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b69b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42db expref: 55 pid: 6529 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583105.398049:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:3.0:1787583105.398061:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+55:2406:x1874416413762816:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583105.398076:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583105.398084:0:13742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b69b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42db expref: 55 pid: 6529 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.398114:0:13742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b69b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42db expref: 55 pid: 6529 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.398136:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b69b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42db expref: 55 pid: 6529 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.398154:0:13742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:3.0:1787583105.398159:0:13742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.398168:0:13742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.398175:0:13742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.398208:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583105.398274:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:2406:x1874416413762816:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 215us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583105.398282:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00010000:00010000:0.0:1787583105.398820:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.398836:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583105.398883:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787583105.399012:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b69c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e2 expref: 55 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.399028:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e2 expref: 54 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.399036:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:0.0:1787583105.399038:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787583105.399042:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480200, rc 0) 00000100:00100000:0.0:1787583105.399655:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:11399:x1874416413762688:12345-192.168.203.11@tcp:101:bash.0 Request processed in 15310us (15492us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787583105.399664:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:0.0:1787583105.404185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583105.405158:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413762944 00000100:00100000:1.0:1787583105.405171:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413762944 00000100:00100000:1.0:1787583105.405334:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:1.0:1787583105.405346:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:11399:x1874416413762944:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1787583105.405370:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583105.405391:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b69da lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42e9 expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.405425:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b69e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.405439:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b69e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.405449:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b69e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.405592:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b69da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e9 expref: 56 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.405609:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b69e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e9 expref: 55 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.405617:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:1.0:1787583105.405620:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787583105.405623:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53800, rc 0) 00000100:00100000:1.0:1787583105.405686:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+55:11399:x1874416413762944:12345-192.168.203.11@tcp:101:bash.0 Request processed in 343us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583105.405700:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:2.0:1787583105.409963:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583105.410056:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413763200 00000100:00100000:3.0:1787583105.410066:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413763200 00000100:00100000:3.0:1787583105.410129:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:3.0:1787583105.410139:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+55:11399:x1874416413763200:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:3.0:1787583105.410416:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b69e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.410444:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b69e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.410475:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b69e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787583105.410532:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1787583105.410555:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c18e5c3d reply state 000000008fc23a0a transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b69e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.410568:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b69e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.410576:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:3.0:1787583105.410579:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787583105.410583:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787583105.410670:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:11399:x1874416413763200:12345-192.168.203.11@tcp:36:bash.0 Request processed in 531us (717us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787583105.410678:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 117 00000020:00080000:3.0:1787583105.410683:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787583105.413082:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583105.413661:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413763328 00000100:00100000:0.0:1787583105.413674:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413763328 00000100:00100000:0.0:1787583105.413733:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:0.0:1787583105.413743:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:11399:x1874416413763328:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1787583105.413765:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583105.413785:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b69ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.413896:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.413925:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e2 expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.413933:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.413969:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e2 expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.413982:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e2 expref: 59 pid: 6527 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583105.413997:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874416435857792:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583105.414085:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b37240 going to sleep for 11 seconds 00000100:00100000:2.0:1787583105.419576:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583105.419691:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413763456 00000100:00100000:0.0:1787583105.419700:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413763456 00010000:00010000:0.0:1787583105.419740:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e2 expref: 60 pid: 6527 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583105.419782:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:0.0:1787583105.419792:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:2406:x1874416413763456:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583105.419806:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583105.419822:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e2 expref: 60 pid: 6527 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.419835:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e2 expref: 60 pid: 6527 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.419890:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:0.0:1787583105.419896:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.419905:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.419912:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.419931:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583105.419982:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:2406:x1874416413763456:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 191us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583105.419990:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00010000:00010000:0.0:1787583105.420037:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b69cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e2 expref: 59 pid: 6527 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583105.420064:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874416435857792:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583105.420085:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.420093:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.420099:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583105.420150:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787583105.420160:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583105.420182:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.420214:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b69ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42f0 expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.420229:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42f0 expref: 58 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.420237:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:0.0:1787583105.420240:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787583105.420242:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e800, rc 0) 00000100:00100000:0.0:1787583105.420268:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:11399:x1874416413763328:12345-192.168.203.11@tcp:101:bash.0 Request processed in 6527us (7196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583105.420274:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 118 00010000:00010000:0.0:1787583105.421958:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583105.427246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.427334:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413763712 00000100:00100000:2.0:1787583105.427343:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413763712 00000100:00100000:2.0:1787583105.427396:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1787583105.427407:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:11399:x1874416413763712:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1787583105.427640:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:11399:x1874416413763712:12345-192.168.203.11@tcp:35:bash.0 Request processed in 234us (402us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1787583105.427648:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:1.0:1787583105.495253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583105.495396:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413763840 00000100:00100000:3.0:1787583105.495406:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413763840 00000100:00100000:3.0:1787583105.495468:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:3.0:1787583105.495480:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:11405:x1874416413763840:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1787583105.495511:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583105.495530:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b69fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42f7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.495591:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6a04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.495619:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.495631:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583105.495680:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787583105.495684:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787583105.495704:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.495727:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b69fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42f7 expref: 61 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.495744:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6a04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42f7 expref: 60 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.495753:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:3.0:1787583105.495756:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787583105.495759:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344decc00, rc 0) 00000100:00100000:3.0:1787583105.496097:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11405:x1874416413763840:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 618us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583105.496104:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:0.0:1787583105.499500:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.499605:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413763968 00000100:00100000:2.0:1787583105.499616:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413763968 00000100:00100000:2.0:1787583105.499679:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:2.0:1787583105.499690:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11405:x1874416413763968:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583105.499721:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583105.499745:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6a0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c42fe expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.499822:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a12 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.499836:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.499895:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.499908:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6a19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.499916:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6a19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.499925:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6a19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.499995:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500018:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500026:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583105.500066:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787583105.500070:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583105.500087:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500098:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500106:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500113:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a12 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500120:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500125:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583105.500130:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500136:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a12 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500147:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:2.0:1787583105.500150:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583105.500161:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500167:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500186:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6a19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500193:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6a19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500199:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6a19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500204:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583105.500207:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6a19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500213:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6a19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500232:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909351203e00) 00010000:00010000:2.0:1787583105.500235:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583105.500238:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6a19 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500244:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6a19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500272:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6a0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42fe expref: 62 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500300:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42fe expref: 61 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583105.500308:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:2.0:1787583105.500311:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583105.500313:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480a00, rc 0) 00000100:00100000:2.0:1787583105.500372:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11405:x1874416413763968:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 684us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583105.500379:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:2.0:1787583105.504766:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.504808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583105.504887:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413764352 00000100:00100000:0.0:1787583105.504896:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413764352 00000100:00100000:0.0:1787583105.504947:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:0.0:1787583105.504956:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11405:x1874416413764352:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583105.504974:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583105.504991:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6a27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4305 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.505087:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.505119:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42f0 expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.505127:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42fe expref: 62 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.505135:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.505165:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42fe expref: 62 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.505177:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42fe expref: 62 pid: 7748 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583105.505190:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fceb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874416435857920:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583105.505290:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42f0 expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.505300:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42f0 expref: 62 pid: 6527 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583105.505309:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874416435858048:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583105.505328:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b37240 going to sleep for 11 seconds 00000100:00100000:3.0:1787583105.506064:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413764096 00000100:00100000:3.0:1787583105.506072:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413764096 00010000:00010000:3.0:1787583105.506103:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42fe expref: 63 pid: 7748 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583105.506131:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:3.0:1787583105.506149:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:2407:x1874416413764096:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583105.506159:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583105.506165:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42fe expref: 63 pid: 7748 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.506178:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42fe expref: 63 pid: 7748 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.506198:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:3.0:1787583105.506203:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.506211:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.506230:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583105.506276:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:2407:x1874416413764096:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 127us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583105.506283:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:2.0:1787583105.510216:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583105.510374:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413764480 00000100:00100000:3.0:1787583105.510383:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413764480 00010000:00010000:3.0:1787583105.510422:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42f0 expref: 63 pid: 6527 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583105.510461:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:3.0:1787583105.510471:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:2404:x1874416413764480:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583105.510484:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583105.510501:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42f0 expref: 63 pid: 6527 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.510530:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42f0 expref: 63 pid: 6527 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.510552:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:3.0:1787583105.510557:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.510565:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.510573:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583105.510596:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583105.510644:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:2404:x1874416413764480:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 173us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583105.510652:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00010000:00010000:0.0:1787583105.510662:0:6527:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.11@tcp) returned -22 from blocking AST (req@00000000516d6a16 x1874416435857920) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42fe expref: 63 pid: 7748 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.510694:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6a20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42fe expref: 62 pid: 7748 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583105.510713:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fceb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874416435857920:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583105.510730:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b69f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42f0 expref: 61 pid: 6527 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583105.510741:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874416435858048:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583105.510774:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:0.0:1787583105.510781:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.510790:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.510797:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583105.510826:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787583105.511000:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6a27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4305 expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.511015:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4305 expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.511023:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:0.0:1787583105.511031:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787583105.511034:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e600, rc 0) 00000100:00100000:0.0:1787583105.511062:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11405:x1874416413764352:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 6107us (6252us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787583105.511068:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:2.0:1787583105.516078:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583105.516166:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413764736 00000100:00100000:0.0:1787583105.516175:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413764736 00000100:00100000:0.0:1787583105.516248:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:0.0:1787583105.516258:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11405:x1874416413764736:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:0.0:1787583105.516273:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583105.516296:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b697f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42d4 expref: 61 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.516313:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:0.0:1787583105.516318:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583105.516374:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11405:x1874416413764736:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 117us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583105.516380:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:1.0:1787583105.519048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583105.519300:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413764864 00000100:00100000:0.0:1787583105.519310:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413764864 00000100:00100000:0.0:1787583105.519442:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:0.0:1787583105.519452:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f14df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11405:x1874416413764864:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:0.0:1787583105.519715:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6a3c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.519732:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6a3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583105.520828:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6a3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787583105.520958:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787583105.521060:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f14df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11405:x1874416413764864:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 1605us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583105.521069:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:2.0:1787583105.526194:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583105.527460:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413764992 00000100:00100000:1.0:1787583105.527475:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413764992 00000100:00100000:1.0:1787583105.527598:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:1.0:1787583105.527609:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:11405:x1874416413764992:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1787583105.527628:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583105.527647:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6a43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c430c expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.527698:0:13828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6a3c lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.527709:0:13828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6a43 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c430c expref: 61 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.527728:0:13828:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6a3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.527746:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6a43 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c430c expref: 61 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.527759:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:1.0:1787583105.527762:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787583105.527766:0:13828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6a43 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c430c expref: 61 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583105.527805:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52000, rc 0) 00000100:00100000:1.0:1787583105.527899:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11405:x1874416413764992:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 292us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583105.527906:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:2.0:1787583105.810227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.810267:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.810291:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.810332:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.810347:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583105.810364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583105.810436:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413765120 00000100:00100000:0.0:1787583105.810440:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413765248 00000100:00100000:1.0:1787583105.810446:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413765120 00000100:00100000:0.0:1787583105.810447:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413765248 00000100:00100000:1.0:1787583105.810509:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 379 00000100:00100000:0.0:1787583105.810510:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413765760 00000100:00100000:0.0:1787583105.810515:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413765760 00000100:00100000:1.0:1787583105.810523:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:2404:x1874416413765120:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583105.810540:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413765632 00000100:00100000:0.0:1787583105.810544:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413765632 00000100:00100000:0.0:1787583105.810570:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 280 00000100:00100000:0.0:1787583105.810579:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413765248:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583105.810590:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:2404:x1874416413765120:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 69us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583105.810598:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 379 00000100:00100000:0.0:1787583105.810620:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413765248:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 42us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583105.810628:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 280 00000100:00100000:1.0:1787583105.810638:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 281 00000100:00100000:0.0:1787583105.810649:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 282 00000100:00100000:1.0:1787583105.810651:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2404:x1874416413765760:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583105.810664:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2404:x1874416413765632:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583105.810683:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2404:x1874416413765760:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583105.810690:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 281 00000100:00100000:0.0:1787583105.810700:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b124cdab-8363-4433-96a8-2d8722f1634b+5:2404:x1874416413765632:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 40us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583105.810706:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 282 00000100:00100000:3.0:1787583105.810787:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413765504 00000100:00100000:3.0:1787583105.810800:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413765504 00000100:00100000:3.0:1787583105.810834:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413765376 00000100:00100000:3.0:1787583105.810837:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413765376 00000100:00100000:3.0:1787583105.810892:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:3.0:1787583105.810900:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2404:x1874416413765504:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583105.810929:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2404:x1874416413765504:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583105.810935:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:3.0:1787583105.810947:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:3.0:1787583105.810970:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2404:x1874416413765376:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583105.810998:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2404:x1874416413765376:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583105.811004:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00080000:2.0:1787583105.811293:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787583105.811298:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583105.811300:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787583105.998096:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435858176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583105.998192:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583105.998375:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435858176 00000100:00100000:3.0:1787583105.998382:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435858176 00000100:00100000:3.0:1787583105.998438:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787583105.998447:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435858176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787583105.998477:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787583105.998542:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435858176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583105.998548:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787583105.998755:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435858176:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787583106.126038:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787583106.126046:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787583106.126085:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787583106.126098:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787583106.126222:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcea300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874416435858304:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787583106.126337:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b37300 going to sleep for 11 seconds 00000100:00100000:2.0:1787583106.130904:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583106.130993:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413765888 00000100:00100000:1.0:1787583106.131001:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413765888 00000100:00100000:1.0:1787583106.131063:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:1.0:1787583106.131075:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:11406:x1874416413765888:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787583106.131122:0:7748:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787583106.131242:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:11406:x1874416413765888:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 169us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583106.131249:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:0.0:1787583106.131588:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcea300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874416435858304:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787583106.134885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583106.136345:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413766016 00000100:00100000:1.0:1787583106.136358:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413766016 00000100:00100000:1.0:1787583106.136428:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:1.0:1787583106.136438:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11406:x1874416413766016:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787583106.136518:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6a4a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136533:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6a4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136547:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6a4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136562:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a51 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136569:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136576:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136597:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136605:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136626:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583106.136672:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787583106.136676:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787583106.136688:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136699:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6a4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136705:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6a4a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136711:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6a4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136716:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583106.136721:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6a4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136728:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6a4a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136740:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90937e015500) 00010000:00010000:1.0:1787583106.136742:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583106.136747:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6a4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136753:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6a4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136776:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136782:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a51 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136787:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136793:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583106.136796:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136802:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a51 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136809:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff909342920700) 00010000:00010000:1.0:1787583106.136811:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583106.136814:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a51 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136819:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a51 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136832:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136838:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136843:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136904:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583106.136908:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136914:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136923:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:1.0:1787583106.136926:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583106.136929:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.136936:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583106.137018:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11406:x1874416413766016:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 581us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583106.137026:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:3.0:1787583106.141413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583106.141482:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413766272 00000100:00100000:2.0:1787583106.141502:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413766272 00000100:00100000:2.0:1787583106.141569:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:2.0:1787583106.141580:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:11406:x1874416413766272:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583106.141600:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583106.141621:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6a5f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4313 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.141729:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.141743:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.141755:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583106.141767:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787583106.141889:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.141897:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.141904:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.141909:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583106.141913:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.141920:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.141943:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:2.0:1787583106.141946:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787583106.141951:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.141957:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6a66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.141998:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6a5f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4313 expref: 63 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.142008:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90937e015500) 00010000:00010000:2.0:1787583106.142011:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787583106.142015:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6a5f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4313 expref: 63 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.142026:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481800, rc 0) 00000100:00100000:2.0:1787583106.142087:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:11406:x1874416413766272:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 509us (682us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1787583106.142095:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:2.0:1787583106.145837:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.145936:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413766400 00000100:00100000:0.0:1787583106.145945:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413766400 00000100:00100000:0.0:1787583106.146004:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:0.0:1787583106.146015:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:11406:x1874416413766400:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787583106.146051:0:6529:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787583106.146164:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:11406:x1874416413766400:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 151us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583106.146170:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:3.0:1787583106.152252:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.152409:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413766656 00000100:00100000:0.0:1787583106.152419:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413766656 00000100:00100000:0.0:1787583106.152482:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:0.0:1787583106.152503:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:11406:x1874416413766656:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787583106.152522:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583106.152526:0:13828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787583106.152551:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6a04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42f7 expref: 62 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.152571:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583106.152575:0:13828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787583106.152587:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6a74 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c431a expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787583106.153002:0:13828:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787583106.153147:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6a7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.153161:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.153170:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.153217:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6a74 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c431a expref: 64 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.153232:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6a7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c431a expref: 63 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.153239:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90937e013b00) 00010000:00010000:0.0:1787583106.153241:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787583106.153243:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fc00, rc 0) 00000100:00100000:0.0:1787583106.153594:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:11406:x1874416413766656:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1090us (1348us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787583106.153603:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:3.0:1787583106.170836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583106.175967:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413766912 00000100:00100000:1.0:1787583106.175983:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413766912 00000100:00100000:1.0:1787583106.176054:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:1.0:1787583106.176066:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:11406:x1874416413766912:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787583106.176122:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583106.176160:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6a7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c431a expref: 63 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.176182:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90937e013b00) 00010000:00010000:1.0:1787583106.176192:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583106.176230:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a89 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.176245:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.176256:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177664:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xc2e3f86f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177683:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc2e3f86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177693:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc2e3f86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177748:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177756:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a89 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177763:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a89 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177769:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583106.177773:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a89 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177780:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a89 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177808:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:1.0:1787583106.177811:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583106.177816:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a89 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177822:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6a89 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177837:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc2e3f86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177843:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a90 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc2e3f86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177874:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc2e3f86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177880:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583106.177883:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc2e3f86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177889:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a90 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc2e3f86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177898:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xc2e3f86f (ffff909342920700) 00010000:00010000:1.0:1787583106.177900:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583106.177904:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a90 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc2e3f86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.177909:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6a90 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc2e3f86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583106.178025:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:11406:x1874416413766912:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1957us (7193us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787583106.178035:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:3.0:1787583106.180090:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583106.183829:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413767040 00000100:00100000:1.0:1787583106.183860:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413767040 00000100:00100000:1.0:1787583106.183939:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:1.0:1787583106.183951:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:11406:x1874416413767040:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787583106.183972:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583106.183995:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6a97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4321 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.184030:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6a9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.184043:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.184055:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.184264:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6a97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4321 expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.184284:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4321 expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.184292:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:1.0:1787583106.184302:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787583106.184307:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53600, rc 0) 00000100:00100000:1.0:1787583106.184375:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:11406:x1874416413767040:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 426us (4293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583106.184382:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:2.0:1787583106.193212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.194791:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413767296 00000100:00100000:0.0:1787583106.194804:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413767296 00000100:00100000:0.0:1787583106.194904:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:0.0:1787583106.194919:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:11406:x1874416413767296:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787583106.195004:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6aa5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.195035:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.195047:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787583106.195212:0:13828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787583106.195223:0:13828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413348376167ns, next at 414348373347ns, rc = 0 00000004:00010000:0.0:1787583106.195271:0:13828:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000161f3f5c reply state 00000000d01115ea transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.195285:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6aa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.195292:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:0.0:1787583106.195296:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787583106.195299:0:13828:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787583106.195399:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:11406:x1874416413767296:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 485us (2196us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787583106.195407:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:0.0:1787583106.204375:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583106.205099:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413767424 00000100:00100000:2.0:1787583106.205108:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413767424 00000100:00100000:2.0:1787583106.205160:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:2.0:1787583106.205168:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:11406:x1874416413767424:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583106.205190:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583106.205227:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6aac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4328 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.205290:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6aac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4328 expref: 66 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.205311:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6aac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4328 expref: 66 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.205332:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:2.0:1787583106.205335:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787583106.205339:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480200, rc 0) 00000100:00100000:2.0:1787583106.205516:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:11406:x1874416413767424:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 347us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583106.205523:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:3.0:1787583106.209386:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.209536:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413767552 00000100:00100000:0.0:1787583106.209544:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413767552 00000100:00100000:0.0:1787583106.209607:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:0.0:1787583106.209617:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937e5a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2406:x1874416413767552:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787583106.209931:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937e5a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2406:x1874416413767552:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 313us (549us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787583106.209939:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:1.0:1787583106.212863:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583106.212900:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413767808 00000100:00100000:3.0:1787583106.212909:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413767808 00000100:00100000:3.0:1787583106.212967:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:3.0:1787583106.212977:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:11406:x1874416413767808:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787583106.213573:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+67:11406:x1874416413767808:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 593us (730us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1787583106.213583:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:2.0:1787583106.215919:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.216128:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413768064 00000100:00100000:0.0:1787583106.216137:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413768064 00000100:00100000:0.0:1787583106.216195:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:0.0:1787583106.216205:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+67:11406:x1874416413768064:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787583106.216400:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+67:11406:x1874416413768064:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 194us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583106.216408:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:2.0:1787583106.218183:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583106.218261:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413768192 00000100:00100000:1.0:1787583106.218269:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413768192 00000100:00100000:1.0:1787583106.218322:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:1.0:1787583106.218332:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+67:11406:x1874416413768192:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787583106.218349:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583106.218368:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6ab3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c432f expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.218432:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6aba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.218446:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.218457:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583106.218516:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787583106.218536:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.218560:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b6ab3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c432f expref: 69 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.218600:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6aba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c432f expref: 68 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.218608:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:1.0:1787583106.218611:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787583106.218615:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52200, rc 0) 00000100:00100000:1.0:1787583106.218670:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+68:11406:x1874416413768192:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 340us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583106.218677:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:3.0:1787583106.221185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.221289:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413768320 00000100:00100000:0.0:1787583106.221297:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413768320 00000100:00100000:0.0:1787583106.221371:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:0.0:1787583106.221381:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413768320:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787583106.221398:0:8752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583106.221416:0:8752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6ac1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4336 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787583106.221441:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c5a80, blocks: 0x0 00010000:00010000:0.0:1787583106.221459:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1787583106.221464:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583106.221473:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6ac1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4336 expref: 10 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.221500:0:8752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6ac1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4336 expref: 10 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.221513:0:8752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fc00, rc 0) 00000100:00100000:0.0:1787583106.221570:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:2407:x1874416413768320:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 191us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583106.221584:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1787583106.223683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.223906:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413768576 00000100:00100000:0.0:1787583106.223914:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413768576 00000100:00100000:0.0:1787583106.223956:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:0.0:1787583106.223965:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+68:11406:x1874416413768576:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787583106.224065:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+68:11406:x1874416413768576:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 100us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583106.224073:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:2.0:1787583106.226342:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583106.226582:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413768704 00000100:00100000:3.0:1787583106.226589:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413768704 00000100:00100000:3.0:1787583106.226632:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:3.0:1787583106.226639:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:11406:x1874416413768704:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787583106.226653:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583106.226670:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c433d expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583106.226708:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6ac1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4336 expref: 11 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583106.226720:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583106.226724:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583106.226729:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c433d expref: 11 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583106.226764:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6ac1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4336 expref: 11 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583106.227088:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6ac1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4336 expref: 11 pid: 8752 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583106.227106:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ea5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8444:1874416435858432:192.168.203.11@tcp:104: 00000100:00100000:3.0:1787583106.227200:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b0c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583106.228901:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ea5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8444:1874416435858432:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583106.228934:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c433d expref: 11 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.228952:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344deda00, rc 0) 00000100:00100000:2.0:1787583106.229076:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:11406:x1874416413768704:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 2434us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583106.229084:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:2.0:1787583106.230201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.230310:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413768832 00000100:00100000:0.0:1787583106.230318:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413768832 00010000:00010000:0.0:1787583106.230351:0:13742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6ac1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4336 expref: 11 pid: 8752 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583106.230455:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:0.0:1787583106.230466:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093770b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:2407:x1874416413768832:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583106.230480:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583106.230514:0:13742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6ac1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4336 expref: 11 pid: 8752 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.230526:0:13742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6ac1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4336 expref: 11 pid: 8752 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.230548:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6ac1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4336 expref: 11 pid: 8752 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.230579:0:13742:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583106.230583:0:13742:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583106.230592:0:13742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c433d expref: 10 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.230602:0:13742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c433d expref: 10 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.230639:0:13742:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c433d expref: 10 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583106.230653:0:13742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13742:1874416435858560:192.168.203.11@tcp:105: 00000100:00100000:0.0:1787583106.230735:0:13742:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b37000 going to sleep for 11 seconds 00000100:00100000:2.0:1787583106.234407:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583106.234521:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413768960 00000100:00100000:3.0:1787583106.234530:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413768960 00002000:00100000:3.0:1787583106.234581:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff90937fd91f80 x1874416413768960/t0(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:572/0 lens 504/0 e 0 to 0 dl 1787583117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787583106.234591:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90937fd91f80 with x1874416413768960 ext(0->12) 00002000:00010000:3.0:1787583106.234596:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90937fd91f80 00000100:00100000:3.0:1787583106.234631:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1787583106.234641:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:2406:x1874416413768960:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787583106.239145:0:13742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13742:1874416435858560:192.168.203.11@tcp:105: 00010000:00010000:0.0:1787583106.239173:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583106.239371:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093770b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+13:2407:x1874416413768832:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 8906us (9173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583106.239382:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:1.0:1787583106.239629:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+12:2406:x1874416413768960:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 4988us (5230us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787583106.239637:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00002000:00100000:1.0:1787583106.239647:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff90937fd91f80 x1874416413768960/t4294967309(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:572/0 lens 504/448 e 0 to 0 dl 1787583117 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787583106.239657:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90937fd91f80 with x1874416413768960 ext(0->12) 00002000:00010000:1.0:1787583106.239662:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90937fd91f80 00000100:00100000:2.0:1787583106.242418:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.242462:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413769088 00000100:00100000:0.0:1787583106.242471:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413769088 00000100:00100000:0.0:1787583106.242540:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:0.0:1787583106.242550:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+68:11406:x1874416413769088:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787583106.244300:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1787583106.244315:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1787583106.244352:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787583106.244374:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff909247c916c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787583106.244378:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff909365d61800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff909247c913c0 00000020:00080000:1.0:1787583106.244381:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff909365d61400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9092465cf600 00000020:00080000:1.0:1787583106.244416:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9092476900c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787583106.244419:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff909344b79600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff909247690180 00000020:00080000:1.0:1787583106.244430:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff909344b79b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff909346180400 00000020:00080000:1.0:1787583106.244441:0:6506:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1787583106.244620:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435858816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787583106.244676:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583106.244708:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787583106.244713:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435858688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787583106.244733:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583106.244761:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435858816 00000100:00100000:3.0:1787583106.244766:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435858816 00010000:00010000:0.0:1787583106.244883:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b67cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.244906:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b67cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.244913:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b67cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.244919:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583106.244924:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b67cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.244932:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b67cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.244948:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff909345181300) 00010000:00010000:0.0:1787583106.244951:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583106.244955:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b67cd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.244962:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b67cd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.244982:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6875 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.244988:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6875 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.244994:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6875 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.244999:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583106.245007:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6875 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245013:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6875 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245021:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff909342920100) 00010000:00010000:0.0:1787583106.245023:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583106.245026:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6875 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245032:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6875 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245045:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245051:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245056:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245061:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583106.245063:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245068:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245075:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909351203e00) 00010000:00010000:0.0:1787583106.245077:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583106.245085:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68f3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245091:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b68f3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245101:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6916 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245107:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6916 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245112:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6916 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245117:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583106.245119:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6916 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245124:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6916 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245131:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff909351203e00) 00010000:00010000:0.0:1787583106.245134:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583106.245137:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6916 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245142:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6916 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245156:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b69e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245173:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b69e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245179:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b69e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245184:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583106.245187:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b69e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245193:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b69e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245202:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:0.0:1787583106.245204:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583106.245207:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b69e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245213:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b69e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245226:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6aa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245231:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6aa5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245237:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6aa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245241:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713ec00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583106.245260:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6aa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245267:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6aa5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245275:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:0.0:1787583106.245278:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787583106.245280:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6aa5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245286:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6aa5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787583106.245303:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787583106.245362:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787583106.245543:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583106.245554:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fd91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435858944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787583106.245582:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583106.245707:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:11406:x1874416413769088:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 3156us (3294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583106.245716:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:0.0:1787583106.245743:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435858688 00000100:00100000:0.0:1787583106.245746:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435858688 00000100:00100000:0.0:1787583106.245777:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435858944 00000100:00100000:0.0:1787583106.245780:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435858944 00000100:00100000:0.0:1787583106.245792:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787583106.245807:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3656:x1874416435858688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787583106.245827:0:8442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1787583106.245876:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245893:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b6883 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4295 expref: 11 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245908:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787583106.245912:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583106.245916:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245941:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b6883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4295 expref: 11 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.245956:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b6883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4295 expref: 11 pid: 8444 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583106.245967:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fceb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8442:1874416435859072:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583106.246006:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b37180 going to sleep for 11 seconds 00000100:00100000:2.0:1787583106.246183:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787583106.246191:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3654:x1874416435858944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787583106.246204:0:8444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1787583106.246224:0:8444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c5a7f, atime: 0x6a8c5a7f, ctime: 0x6a8c5a7f, blocks: 0x8 00010000:00010000:2.0:1787583106.246230:0:8444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6ad6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.246238:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1787583106.246241:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583106.246246:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6ad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.246260:0:8444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6ad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.246268:0:8444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6ad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.246276:0:8444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6ad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.246312:0:8444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787583106.246440:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3654:x1874416435858944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 250us (857us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787583106.246446:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787583106.246447:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787583106.246458:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1787583106.246535:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787583106.246542:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6ad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.246549:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480a00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787583106.246553:0:7469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6ad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.246561:0:7469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.246577:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6ad6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.246584:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6ad6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.246600:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583106.246602:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583106.246603:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583106.246614:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3656:x1874416435858816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787583106.246709:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787583106.246713:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787583105 00002000:00010000:2.0:1787583106.246715:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787583106.246718:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787583104 -> 1787583105 00002000:00010000:2.0:1787583106.246720:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787583106.246754:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3656:x1874416435858816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 289us (2077us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787583106.246760:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1787583106.246797:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90937fd91500/2, rc 0, transno 4294967305 00000100:00100000:2.0:1787583106.246803:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fd91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435858944:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1787583106.247075:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff909247ea7800/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787583106.247082:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435858816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787583106.250143:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.250199:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fceb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8442:1874416435859072:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583106.250300:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583106.250731:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413769216 00000100:00100000:1.0:1787583106.250739:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413769216 00010000:00010000:1.0:1787583106.250775:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b6883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4295 expref: 12 pid: 8444 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583106.251047:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:3.0:1787583106.251054:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583106.251057:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+12:2406:x1874416413769216:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583106.251072:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583106.251078:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b6883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4295 expref: 12 pid: 8444 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.251091:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b6883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4295 expref: 12 pid: 8444 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.251113:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcb10478/0x19a47956376b6883 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4295 expref: 12 pid: 8444 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583106.251122:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413769344 00000100:00100000:2.0:1787583106.251126:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413769344 00010000:00010000:1.0:1787583106.251128:0:6513:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787583106.251132:0:6513:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787583106.251137:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.251146:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583106.251157:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:2.0:1787583106.251164:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+12:2404:x1874416413769344:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1787583106.251167:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583106.251208:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+12:2406:x1874416413769216:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 153us (1078us total) trans 0 rc 0/0 00010000:00010000:0.0:1787583106.251327:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.251338:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.251348:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.251362:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.251374:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787583106.251389:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583106.251395:0:10405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.251414:0:10405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583106.251419:0:10405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.251427:0:10405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.251439:0:10405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.251447:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b6acf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.251464:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583106.251466:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583106.251467:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583106.251695:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:0.0:1787583106.252735:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3656:x1874416435858688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6924us (7996us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787583106.252743:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:1.0:1787583106.252963:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff909247ea5c00/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787583106.252970:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435858688:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787583106.253646:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1787583106.253657:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1787583106.254013:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413769344:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 2846us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583106.254023:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:3.0:1787583106.256582:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583106.256753:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413769600 00000100:00100000:1.0:1787583106.256762:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413769600 00000100:00100000:1.0:1787583106.256817:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:1.0:1787583106.256838:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:11406:x1874416413769600:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787583106.256913:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583106.256938:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6aba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c432f expref: 16 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.256956:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:1.0:1787583106.256960:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583106.256989:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6add lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.257002:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6add lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.257010:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6add lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583106.257130:0:7748:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b388b313 reply state 00000000e5fc5983 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6add lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.257142:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6add lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.257148:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:1.0:1787583106.257151:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787583106.257169:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787583106.258417:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+17:11406:x1874416413769600:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1586us (1837us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1787583106.258432:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:2.0:1787583106.261255:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583106.261396:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413769728 00000100:00100000:3.0:1787583106.261405:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413769728 00000100:00100000:3.0:1787583106.261455:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:3.0:1787583106.261465:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413769728:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787583106.261640:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787583106.261644:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787583105 -> 1787583104 00002000:00010000:3.0:1787583106.261647:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787583103 00002000:00010000:3.0:1787583106.261649:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787583105 -> 1787583104 00002000:00010000:3.0:1787583106.261651:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787583106.261717:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413769728:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 253us (470us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787583106.261725:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1787583106.270418:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583106.270519:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413769984 00000100:00100000:2.0:1787583106.270528:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413769984 00000100:00100000:2.0:1787583106.270586:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:2.0:1787583106.270599:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+17:11406:x1874416413769984:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787583106.270666:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.270702:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6a9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4321 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.270723:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.270765:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4321 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.270785:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4321 expref: 17 pid: 6527 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583106.270801:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fd91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435859200:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583106.271059:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787583106.273979:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583106.274084:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fd91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435859200:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583106.274113:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583106.274501:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413770112 00000100:00100000:3.0:1787583106.274509:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413770112 00010000:00010000:3.0:1787583106.274544:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4321 expref: 18 pid: 6527 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583106.274583:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:3.0:1787583106.274593:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:2407:x1874416413770112:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583106.274606:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583106.274613:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4321 expref: 18 pid: 6527 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583106.274626:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4321 expref: 18 pid: 6527 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583106.274645:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6a9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4321 expref: 18 pid: 6527 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583106.274659:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:3.0:1787583106.274680:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583106.274690:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583106.274698:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583106.274736:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583106.274805:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+17:2407:x1874416413770112:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 212us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583106.274813:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00010000:00010000:0.0:1787583106.274935:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.274943:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.274983:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.274989:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.274995:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.275000:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583106.275004:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.275011:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.275028:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:0.0:1787583106.275031:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787583106.275035:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.275041:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6ae4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583106.275080:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:11406:x1874416413769984:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 4485us (4671us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787583106.275088:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:3.0:1787583106.282902:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.282983:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413770240 00000100:00100000:0.0:1787583106.282993:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413770240 00000100:00100000:0.0:1787583106.283049:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:0.0:1787583106.283059:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413770240:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787583106.283100:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.283121:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c433d expref: 7 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.283130:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583106.283134:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583106.283138:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.283172:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c433d expref: 7 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.283201:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c433d expref: 7 pid: 8444 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583106.283217:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8442:1874416435859328:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583106.283301:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b37a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787583106.286768:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8442:1874416435859328:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583106.286794:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583106.287781:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.289288:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413770368 00000100:00100000:0.0:1787583106.289301:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413770368 00010000:00010000:0.0:1787583106.289349:0:13742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c433d expref: 8 pid: 8444 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583106.289410:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:0.0:1787583106.289421:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2407:x1874416413770368:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583106.289438:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583106.289461:0:13742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c433d expref: 8 pid: 8444 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.289475:0:13742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c433d expref: 8 pid: 8444 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.289509:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b6ac8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c433d expref: 8 pid: 8444 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.289544:0:13742:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583106.289549:0:13742:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583106.289555:0:13742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.289566:0:13742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.289604:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583106.289671:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413770368:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 251us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583106.289679:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00010000:00010000:1.0:1787583106.289742:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.289754:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.289777:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.289786:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.289794:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.289801:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fa00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787583106.289805:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.289814:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.289826:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.289841:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015db0162/0x19a47956376b6aeb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583106.289914:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413770240:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 6855us (7020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583106.289923:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:1.0:1787583106.294801:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.298981:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413770624 00000100:00100000:0.0:1787583106.298996:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413770624 00000100:00100000:0.0:1787583106.299120:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:0.0:1787583106.299132:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:11406:x1874416413770624:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787583106.299219:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.299237:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b69e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e9 expref: 16 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.299247:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.299283:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b69e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e9 expref: 16 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.299313:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b69e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e9 expref: 16 pid: 13828 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583106.299328:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435859456:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583106.299421:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b37a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787583106.306292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583106.306456:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413770752 00000100:00100000:2.0:1787583106.306465:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413770752 00010000:00010000:2.0:1787583106.306516:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b69e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e9 expref: 17 pid: 13828 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583106.306559:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1787583106.306569:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+17:2407:x1874416413770752:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583106.306584:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583106.306605:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b69e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e9 expref: 17 pid: 13828 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.306619:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b69e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e9 expref: 17 pid: 13828 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.306642:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:2.0:1787583106.306648:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6a43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c430c expref: 17 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.306658:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.306666:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.306674:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.306693:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583106.306748:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+17:2407:x1874416413770752:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 180us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583106.306757:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00010000:00010000:0.0:1787583106.306764:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b69e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c42e9 expref: 17 pid: 13828 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583106.306785:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435859456:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583106.306807:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.306817:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.306824:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.307031:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.307042:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6aac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4328 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.307050:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.307087:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6aac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4328 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.307106:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6aac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4328 expref: 16 pid: 6529 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583106.307119:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435859584:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583106.307182:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b379c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583106.310330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.310570:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435859584:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583106.310598:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583106.310938:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413770880 00000100:00100000:2.0:1787583106.310946:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413770880 00010000:00010000:2.0:1787583106.310983:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6aac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4328 expref: 17 pid: 6529 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583106.311018:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:2.0:1787583106.311028:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+17:2407:x1874416413770880:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583106.311057:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583106.311064:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6aac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4328 expref: 17 pid: 6529 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.311077:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6aac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4328 expref: 17 pid: 6529 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.311097:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6aac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4328 expref: 17 pid: 6529 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.311112:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:2.0:1787583106.311118:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.311127:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.311134:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.311167:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583106.311205:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.311215:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583106.311216:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:2407:x1874416413770880:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 188us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583106.311233:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000001:00080000:1.0:1787583106.311394:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1787583106.311524:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1787583106.311557:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1787583106.311632:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874416435859712:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787583106.311683:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583106.311719:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c910c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583106.316471:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435859712 00000100:00100000:2.0:1787583106.316495:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435859712 00000100:00100000:2.0:1787583106.316554:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787583106.316565:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6528:x1874416435859712:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787583106.316698:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6528:x1874416435859712:12345-0@lo:1000:mdt00_001.0 Request processed in 134us (5013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583106.316722:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787583106.316918:0:6528:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787583106.316925:0:6528:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1787583106.316948:0:6528:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff909247ea7800, transno 4294967310 00000100:00100000:1.0:1787583106.316968:0:6528:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff909247ea5c00 x1874416435858688/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787583122 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583106.316980:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874416435859712:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787583106.317128:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1787583106.317213:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874416435859840:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787583106.317254:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583106.317279:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91900 going to sleep for 11 seconds 00000100:00100000:2.0:1787583106.317514:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435859840 00000100:00100000:2.0:1787583106.317519:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435859840 00000100:00100000:2.0:1787583106.317558:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787583106.317565:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6528:x1874416435859840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787583106.317686:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6528:x1874416435859840:12345-0@lo:1000:mdt00_001.0 Request processed in 120us (430us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787583106.317692:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787583106.318039:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874416435859840:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787583106.318081:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318091:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318099:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318107:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583106.318112:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318120:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318137:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:1.0:1787583106.318140:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787583106.318144:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318151:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6af9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318176:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6a3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318183:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6a3c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318199:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6a3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318205:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583106.318208:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6a3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318215:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6a3c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318223:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:1.0:1787583106.318226:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787583106.318232:0:6528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6a43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c430c expref: 19 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318244:0:6528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6a43 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c430c expref: 19 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318254:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6a43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c430c expref: 19 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.318279:0:6528:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6a43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c430c expref: 19 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583106.318292:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435859968:192.168.203.11@tcp:105: 00000100:00100000:1.0:1787583106.318360:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91900 going to sleep for 11 seconds 00000100:00100000:3.0:1787583106.322237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583106.322322:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413771008 00000100:00100000:2.0:1787583106.322331:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413771008 00000100:00100000:2.0:1787583106.322387:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:2.0:1787583106.322398:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:11405:x1874416413771008:12345-192.168.203.11@tcp:49:lfs.0 00000100:00100000:2.0:1787583106.322537:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:11405:x1874416413771008:12345-192.168.203.11@tcp:49:lfs.0 Request processed in 141us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583106.322545:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:1.0:1787583106.322757:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435859968:192.168.203.11@tcp:105: 00010000:00010000:1.0:1787583106.322798:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6a3c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322808:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6a3c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322838:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6b00 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322886:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6b00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322897:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6b00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322909:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6b00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322916:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6b00 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322923:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6b00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322928:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52c00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583106.322932:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6b00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322940:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6b00 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322951:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:1.0:1787583106.322954:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583106.322964:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6b00 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322969:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6b00 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322980:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322986:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322991:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.322996:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583106.322999:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.323005:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.323013:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:1.0:1787583106.323016:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787583106.323019:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583106.323024:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6af2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583106.323154:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:11406:x1874416413770624:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 24024us (28362us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787583106.323163:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 139 00000020:00080000:1.0:1787583106.323173:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787583106.323305:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787583106.323311:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787583106.323804:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787583106.323813:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787583106.325497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583106.325574:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413771264 00000100:00100000:2.0:1787583106.325583:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413771264 00000100:00100000:2.0:1787583106.325636:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1787583106.325647:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373fa6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:11406:x1874416413771264:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787583106.325951:0:6531:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787583106.325986:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1787583106.326020:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.326036:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.326063:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.326072:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b07 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.326079:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b07 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.326086:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.326104:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787583106.326196:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373fa6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:11406:x1874416413771264:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 550us (717us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787583106.326205:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000020:00080000:2.0:1787583106.326209:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787583106.326518:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583106.326525:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b07 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.326533:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481c00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583106.326537:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b07 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.326545:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.326558:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:0.0:1787583106.326561:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787583106.326566:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b07 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.326581:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b07 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.326595:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583106.326597:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583106.326599:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583106.332178:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583106.339907:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413771520 00000100:00100000:1.0:1787583106.339924:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413771520 00000100:00100000:2.0:1787583106.340111:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:2.0:1787583106.340123:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:11405:x1874416413771520:12345-192.168.203.11@tcp:58:lfs.0 00000040:00080000:2.0:1787583106.340301:0:7748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787583106.340397:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:11405:x1874416413771520:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 276us (8227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583106.340406:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:2.0:1787583106.371385:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.371547:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413771648 00000100:00100000:0.0:1787583106.371558:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413771648 00000100:00100000:0.0:1787583106.371621:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:0.0:1787583106.371632:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:11408:x1874416413771648:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583106.371656:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583106.371676:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6b0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4344 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.371737:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6b15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.371752:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6b15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.371763:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6b15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.371779:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6b1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.371787:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.371793:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.371928:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6b23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.371939:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4305 expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.371947:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6b23 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.371979:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4305 expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.371994:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4305 expref: 22 pid: 6527 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583106.372008:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435860096:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583106.372093:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff909347b379c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583106.376939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583106.377119:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874416435860096:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583106.377148:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6b23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583106.377225:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413771904 00000100:00100000:1.0:1787583106.377232:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413771904 00000100:00100000:1.0:1787583106.377282:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:1.0:1787583106.377304:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:9937:x1874416413771904:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787583106.377534:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:9937:x1874416413771904:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 231us (603us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787583106.377541:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1787583106.386710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583106.386819:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413772032 00000100:00100000:2.0:1787583106.386830:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413772032 00010000:00010000:2.0:1787583106.387220:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4305 expref: 24 pid: 6527 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583106.387605:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:2.0:1787583106.387617:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:2407:x1874416413772032:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583106.387633:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583106.387641:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4305 expref: 24 pid: 6527 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.387655:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4305 expref: 24 pid: 6527 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.387676:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b6a2e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4305 expref: 24 pid: 6527 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.387694:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:2.0:1787583106.387700:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6b23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.387709:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.387718:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6b23 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583106.387937:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583106.388009:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:2407:x1874416413772032:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 394us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583106.388017:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00010000:00010000:0.0:1787583106.389810:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.389826:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583106.389923:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787583106.389953:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583106.389978:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.389994:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390004:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6b15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390010:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6b15 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390016:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6b15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390022:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583106.390026:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6b15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390033:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6b15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390045:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583106.390048:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583106.390053:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6b15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390058:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6b15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390072:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390088:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6b1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390095:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390100:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583106.390103:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390109:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6b1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390117:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90937e013a00) 00010000:00010000:0.0:1787583106.390120:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583106.390123:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6b1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390128:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6b1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390183:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6b0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4344 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390197:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6b23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4344 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583106.390206:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:0.0:1787583106.390208:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787583106.390217:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e000, rc 0) 00000100:00100000:0.0:1787583106.390683:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:11408:x1874416413771648:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 18656us (18909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583106.390693:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 141 00010000:00010000:0.0:1787583106.445944:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583107.024872:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435860224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583107.024948:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1787583107.025518:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1787583107.025528:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1787583107.026585:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435860224 00000100:00100000:0.0:1787583107.026596:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435860224 00000100:00100000:0.0:1787583107.026662:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787583107.026672:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435860224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583107.026708:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1787583107.026781:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435860224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583107.026788:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787583107.026861:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435860224:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787583107.029881:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583107.030876:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435860352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787583107.030944:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583107.032558:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435860352 00000100:00100000:2.0:1787583107.032570:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435860352 00000100:00100000:2.0:1787583107.032629:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787583107.032640:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1874416435860352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583107.032666:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1787583107.037090:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1874416435860352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4444us (6138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583107.037105:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787583107.038952:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435860352:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787583107.158643:0:14271:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787583107.158652:0:14271:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787583107.158699:0:14271:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787583107.158778:0:14271:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787583107.342410:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787583107.342418:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787583107.342441:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787583107.342446:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787583107.342580:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476ec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874416435860480:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787583107.342677:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344af40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583107.370234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583107.370285:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476ec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874416435860480:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787583107.370393:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413772160 00000100:00100000:3.0:1787583107.370400:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413772160 00000100:00080000:2.0:1787583107.370559:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583107.374511:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:2.0:1787583107.374536:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:11420:x1874416413772160:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787583107.374593:0:6528:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787583107.374738:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:11420:x1874416413772160:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 212us (4511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583107.374746:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:2.0:1787583107.383455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583107.383533:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413772416 00000100:00100000:3.0:1787583107.383551:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413772416 00000100:00100000:3.0:1787583107.383611:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:3.0:1787583107.383623:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:11420:x1874416413772416:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787583107.383643:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583107.383661:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6b2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c434b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.383779:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6b31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.383794:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.383807:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583107.383818:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787583107.383956:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6b2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c434b expref: 25 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.383975:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6b31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c434b expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.383983:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:3.0:1787583107.383986:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787583107.383989:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344decc00, rc 0) 00000100:00100000:3.0:1787583107.384049:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:11420:x1874416413772416:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 428us (602us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787583107.384057:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:0.0:1787583107.389377:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583107.393086:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413772544 00000100:00100000:2.0:1787583107.393100:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413772544 00000100:00100000:2.0:1787583107.393177:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:2.0:1787583107.393189:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093770b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:2405:x1874416413772544:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583107.393205:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583107.393229:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6b31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c434b expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583107.393248:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:2.0:1787583107.393262:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583107.393316:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093770b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:2405:x1874416413772544:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 130us (3947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583107.393324:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:3.0:1787583107.395059:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583107.395156:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413772800 00000100:00100000:3.0:1787583107.395163:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413772800 00000100:00100000:3.0:1787583107.395206:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:3.0:1787583107.395214:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:11420:x1874416413772800:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787583107.395279:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6b3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.395294:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6b3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.395304:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6b3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.395457:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6b3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.395465:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6b3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.395473:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6b3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.395491:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583107.395495:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6b3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.395502:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6b3f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.395514:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:3.0:1787583107.395517:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787583107.395533:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6b3f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583107.395538:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6b3f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583107.395636:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:11420:x1874416413772800:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 421us (582us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787583107.395644:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 144 00000040:00080000:3.0:1787583107.395727:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787583107.395731:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787583107.396415:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787583107.396425:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787583107.401568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583107.401734:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413773056 00000100:00100000:0.0:1787583107.401744:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413773056 00000100:00100000:0.0:1787583107.401807:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1787583107.401818:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:11420:x1874416413773056:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787583107.402057:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+25:11420:x1874416413773056:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 240us (498us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787583107.402064:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00010000:00010000:1.0:1787583107.470075:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583108.046765:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435860864:0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.046836:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583108.046920:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435861376:0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.046947:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583108.046965:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909365f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435861888:0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.046985:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583108.047011:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787583108.047017:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435860736:0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.047038:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583108.047054:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435861248:0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.047073:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583108.047092:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435861760:0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.047112:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583108.047139:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435860864 00000100:00100000:0.0:1787583108.047145:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435860864 00000100:00100000:0.0:1787583108.047185:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787583108.047192:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435860864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.047241:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435860864:12345-0@lo:400:kworker.0 Request processed in 49us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583108.047248:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787583108.047269:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435861376 00000100:00100000:0.0:1787583108.047272:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435861376 00000100:00100000:0.0:1787583108.047299:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435861888 00000100:00100000:0.0:1787583108.047302:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435861888 00000100:00100000:0.0:1787583108.047483:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435860736 00000100:00100000:0.0:1787583108.047487:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435860736 00000100:00100000:0.0:1787583108.047503:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435861248 00000100:00100000:0.0:1787583108.047521:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435861248 00000100:00100000:0.0:1787583108.047537:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435861760 00000100:00100000:0.0:1787583108.047540:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435861760 00000100:00100000:0.0:1787583108.047555:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787583108.047562:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435861376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.047596:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435861376:12345-0@lo:400:kworker.0 Request processed in 35us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583108.047602:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787583108.047613:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787583108.047618:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435861888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.047635:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435861888:12345-0@lo:400:kworker.0 Request processed in 18us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583108.047639:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787583108.047645:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787583108.047648:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435860736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.047661:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435860736:12345-0@lo:400:kworker.0 Request processed in 13us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583108.047664:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787583108.047669:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787583108.047672:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435861248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.047685:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435861248:12345-0@lo:400:kworker.0 Request processed in 12us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583108.047688:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787583108.047693:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787583108.047696:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435861760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.047708:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435861760:12345-0@lo:400:kworker.0 Request processed in 12us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583108.047716:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:0.0:1787583108.047734:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787583108.047736:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787583108.047759:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435860736:0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.047765:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435861248:0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.047770:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435861760:0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.047775:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435860864:0@lo:400:kworker.0 00010000:00080000:0.0:1787583108.047782:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fce9c00 x1874416435861376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583108.047789:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435861376:0@lo:400:kworker.0 00010000:00080000:0.0:1787583108.047794:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909365f16a00 x1874416435861888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583108.047799:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909365f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435861888:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.048085:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435860992:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.048115:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583108.048137:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435861504:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.048159:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583108.048176:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435862016:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.048208:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583108.048233:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787583108.048239:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435860608:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.048265:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583108.048284:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435861120:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.048304:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583108.048452:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435860608 00000100:00100000:2.0:1787583108.048457:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435860608 00000100:00100000:2.0:1787583108.048498:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787583108.048506:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093749e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435860608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583108.048544:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093749e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435860608:12345-0@lo:400:kworker.0 Request processed in 39us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583108.048550:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787583108.048580:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435862272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583108.048605:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583108.048634:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435862272 00000100:00100000:2.0:1787583108.048637:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435862272 00000100:00100000:2.0:1787583108.048667:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787583108.048673:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435862272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787583108.048694:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583108.048728:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435862272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583108.048733:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1787583108.048747:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787583108.048764:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1787583108.048769:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1787583108.048795:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff909247ec8700, transno 4294967302 00000004:00080000:2.0:1787583108.048804:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1787583108.048812:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90937fd91500, transno 4294967305 00000100:00100000:2.0:1787583108.048829:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435862272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583108.049000:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435861504 00000100:00100000:2.0:1787583108.049004:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435861504 00000100:00100000:2.0:1787583108.049026:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435862016 00000100:00100000:2.0:1787583108.049029:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435862016 00000100:00100000:2.0:1787583108.049053:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787583108.049059:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435861504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583108.049091:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435861504:12345-0@lo:400:kworker.0 Request processed in 33us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583108.049097:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787583108.049108:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787583108.049114:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435862016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583108.049138:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435862016:12345-0@lo:400:kworker.0 Request processed in 25us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583108.049143:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1787583108.049156:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787583108.049165:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435860992 00000100:00100000:2.0:1787583108.049167:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435860992 00000100:00100000:2.0:1787583108.049189:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787583108.049195:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435860992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583108.049223:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435860992:12345-0@lo:400:kworker.0 Request processed in 29us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583108.049229:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787583108.049614:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435861632:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.049638:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583108.049657:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435862144:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.049668:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583108.049685:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435860992:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.049691:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435861504:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.049697:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435862016:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.049713:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435860608:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.049726:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435861632 00000100:00100000:1.0:1787583108.049728:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435861632 00000100:00100000:1.0:1787583108.049745:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435862144 00000100:00100000:1.0:1787583108.049747:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435862144 00000100:00100000:1.0:1787583108.049754:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787583108.049757:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3655:x1874416435861632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583108.049885:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787583108.049893:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435862144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.049943:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3655:x1874416435861632:12345-0@lo:400:kworker.0 Request processed in 183us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583108.049949:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1787583108.049963:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787583108.050034:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435861120 00000100:00100000:2.0:1787583108.050038:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435861120 00000100:00100000:2.0:1787583108.050062:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787583108.050068:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435861120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.050171:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583108.050179:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435862400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583108.050631:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435862144:12345-0@lo:400:kworker.0 Request processed in 738us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583108.050639:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787583108.050732:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435861632:0@lo:400:kworker.0 00000100:00100000:1.0:1787583108.050744:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435862144:0@lo:400:kworker.0 00000100:00100000:2.0:1787583108.051226:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435861120:12345-0@lo:400:kworker.0 Request processed in 1156us (2919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583108.051233:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787583108.051298:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435861120:0@lo:400:kworker.0 00000100:00100000:0.0:1787583108.051390:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583108.051638:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435862400 00000100:00100000:2.0:1787583108.051644:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435862400 00000100:00100000:2.0:1787583108.051678:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787583108.051686:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435862400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787583108.051714:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787583108.051760:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435862400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583108.051765:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787583108.052761:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435862400:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787583108.494092:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583108.559264:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435862528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583108.559333:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583108.559441:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435862528 00000100:00100000:3.0:1787583108.559449:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435862528 00000100:00100000:3.0:1787583108.559508:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787583108.559518:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435862528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787583108.559549:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583108.559592:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435862528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583108.559600:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787583108.559803:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435862528:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1787583108.976505:0:14323:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787583108.976513:0:14323:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787583108.976547:0:14323:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787583108.976554:0:14323:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787583109.119200:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583109.119236:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413773312 00000100:00100000:3.0:1787583109.119245:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413773312 00000100:00100000:3.0:1787583109.119304:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:3.0:1787583109.119315:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+25:11440:x1874416413773312:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1787583109.119336:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583109.119354:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6b46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4352 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583109.119454:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6b4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583109.119483:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6b4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583109.119497:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6b4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583109.119509:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787583109.119612:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6b46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4352 expref: 28 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583109.119630:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6b4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4352 expref: 27 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583109.119640:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:3.0:1787583109.119643:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787583109.119647:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367f000, rc 0) 00000100:00100000:3.0:1787583109.119830:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:11440:x1874416413773312:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 514us (638us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787583109.120004:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00080000:1.0:1787583109.125059:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787583109.130661:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583109.130774:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413773440 00000100:00100000:1.0:1787583109.130785:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413773440 00000100:00100000:1.0:1787583109.130875:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:1.0:1787583109.130886:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:11440:x1874416413773440:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:1.0:1787583109.130951:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6b5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583109.130967:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583109.130979:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583109.131016:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583109.131024:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6b5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583109.131030:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583109.131057:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583109.131062:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583109.131069:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6b5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583109.131083:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:1.0:1787583109.131086:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787583109.131091:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6b5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583109.131097:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53800/0x19a47956376b6b5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583109.131181:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:11440:x1874416413773440:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 296us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583109.131189:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:3.0:1787583109.215900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583109.217421:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413773568 00000100:00100000:1.0:1787583109.217434:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413773568 00000100:00100000:1.0:1787583109.217539:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:1.0:1787583109.217550:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413773568:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:1.0:1787583109.217567:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583109.217586:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002968e2a/0x19a47956376b6b62 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4359 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787583109.217612:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c5a80, atime: 0x6a8c5a7f, ctime: 0x6a8c5a80, blocks: 0x8 00010000:00010000:1.0:1787583109.217629:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1787583109.217647:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583109.217656:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002968e2a/0x19a47956376b6b62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4359 expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583109.217674:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002968e2a/0x19a47956376b6b62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4359 expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583109.217688:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53800, rc 0) 00000100:00100000:1.0:1787583109.217751:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413773568:12345-192.168.203.11@tcp:101:cat.0 Request processed in 202us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583109.217757:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00080000:2.0:1787583109.218261:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583109.223287:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583109.223370:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413773696 00000100:00100000:2.0:1787583109.223380:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413773696 00002000:00100000:2.0:1787583109.223429:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff90937fc45f80 x1874416413773696/t0(0) o3->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:575/0 lens 488/0 e 0 to 0 dl 1787583120 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787583109.223441:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90937fc45f80 with x1874416413773696 ext(0->4095) 00002000:00010000:2.0:1787583109.223446:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90937fc45f80 00000100:00100000:2.0:1787583109.223491:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1787583109.223564:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413773696:12345-192.168.203.11@tcp:3:cat.0 00000100:00100000:2.0:1787583109.223752:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413773696:12345-192.168.203.11@tcp:3:cat.0 Request processed in 251us (473us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787583109.223759:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00002000:00100000:2.0:1787583109.223765:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff90937fc45f80 x1874416413773696/t0(0) o3->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:575/0 lens 488/4536 e 0 to 0 dl 1787583120 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787583109.223795:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90937fc45f80 with x1874416413773696 ext(0->4095) 00002000:00010000:2.0:1787583109.223799:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90937fc45f80 00010000:00010000:0.0:1787583109.518129:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583110.542956:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583110.929131:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583110.929192:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583110.929285:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413773824 00000100:00100000:2.0:1787583110.929294:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413773824 00000100:00100000:2.0:1787583110.929349:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 381 00000100:00100000:2.0:1787583110.929361:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093749e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413773824:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583110.929432:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093749e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413773824:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 72us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583110.929439:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 381 00000100:00100000:2.0:1787583110.929624:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583110.929738:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413774080 00000100:00100000:1.0:1787583110.929744:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413774080 00000100:00100000:1.0:1787583110.929791:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:1.0:1787583110.929799:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413774080:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583110.929837:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413774080:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583110.929888:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00080000:2.0:1787583110.929983:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787583110.929989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583110.930015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583110.930043:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583110.930060:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413774592 00000100:00100000:0.0:1787583110.930066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583110.930067:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413774592 00000100:00100000:2.0:1787583110.930114:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413773952 00000100:00100000:2.0:1787583110.930118:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413773952 00000100:00100000:2.0:1787583110.930132:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413774464 00000100:00100000:2.0:1787583110.930134:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413774464 00000100:00100000:2.0:1787583110.930150:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 290 00000100:00100000:2.0:1787583110.930157:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413774592:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583110.930194:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413774592:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583110.930203:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00100000:1.0:1787583110.930213:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:2406:x1874416413773952:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583110.930243:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:2406:x1874416413773952:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583110.930346:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413774336 00000100:00100000:3.0:1787583110.930351:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413774336 00000100:00100000:2.0:1787583110.930510:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 290 00000100:00100000:2.0:1787583110.930528:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 292 00000100:00100000:2.0:1787583110.930536:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413774464:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583110.930564:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413774464:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583110.930657:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 292 00000100:00080000:2.0:1787583110.930677:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787583110.930680:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583110.930682:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787583110.930777:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413774208 00000100:00100000:0.0:1787583110.930782:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413774208 00000100:00100000:0.0:1787583110.930809:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:0.0:1787583110.930816:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413774208:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583110.930877:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413774208:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583110.930884:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:3.0:1787583110.931213:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:3.0:1787583110.931223:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413774336:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583110.931252:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413774336:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 33us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583110.931258:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:1.0:1787583110.936432:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00100000:1.0:1787583111.118201:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787583111.118228:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435862656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583111.118314:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583111.118468:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435862656 00000100:00100000:2.0:1787583111.118477:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435862656 00000100:00100000:2.0:1787583111.118529:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787583111.118539:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435862656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787583111.118575:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787583111.118629:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435862656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583111.118635:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787583111.118833:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435862656:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787583111.567566:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787583111.646387:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1787583111.646400:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1787583111.646883:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1787583111.646911:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff909247c910c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787583111.646916:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff909365d61a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff909247c919c0 00000020:00080000:0.0:1787583111.646919:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff909365d61b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff909247f0dc00 00000020:00080000:0.0:1787583111.646933:0:6506:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1787583111.646952:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6add lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583111.646962:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6add lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583111.646970:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6add lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583111.646984:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583111.646989:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6add lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583111.646997:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6add lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583111.647015:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff909342920300) 00010000:00010000:0.0:1787583111.647018:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583111.647022:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6add lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583111.647029:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6add lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787583111.649478:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787583111.649558:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1787583112.143782:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435862784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583112.143873:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583112.144093:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435862784 00000100:00100000:3.0:1787583112.144101:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435862784 00000100:00100000:2.0:1787583112.144363:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435862912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787583112.144399:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583112.144441:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435862912 00000100:00100000:2.0:1787583112.144454:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435862912 00000100:00100000:2.0:1787583112.144497:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787583112.144506:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435862912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583112.144534:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787583112.144586:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435862912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583112.144593:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1787583112.144739:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583112.144761:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787583112.144770:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435862784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583112.144781:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787583112.144813:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435862784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583112.144819:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787583112.145099:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1787583112.145105:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff909247ea5c00, transno 4294967311 00000004:00080000:3.0:1787583112.145121:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1787583112.145430:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435862784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583112.145544:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435862912:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787583112.595547:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787583113.038534:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787583113.168741:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435863168:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.168812:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.168883:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435863680:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.168908:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.168932:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435864192:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.168954:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.168980:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787583113.168986:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435863040:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169013:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.169052:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435863552:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169079:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.169097:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435864064:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169120:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.169138:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435864576:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169158:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.169185:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936f15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435863424:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169211:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.169229:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435863936:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169247:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.169260:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435864448:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169275:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.169292:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787583113.169297:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435863296:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169316:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.169332:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435863808:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169352:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.169365:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435864320:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169383:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.169407:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435863168 00000100:00100000:3.0:1787583113.169415:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435863168 00000100:00100000:3.0:1787583113.169551:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435863680 00000100:00100000:3.0:1787583113.169555:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435863680 00000100:00100000:3.0:1787583113.169581:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435864192 00000100:00100000:3.0:1787583113.169584:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435864192 00000100:00100000:3.0:1787583113.169598:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435863424 00000100:00100000:3.0:1787583113.169607:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435863424 00000100:00100000:3.0:1787583113.169622:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435863808 00000100:00100000:3.0:1787583113.169625:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435863808 00000100:00100000:3.0:1787583113.169636:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435864320 00000100:00100000:3.0:1787583113.169638:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435864320 00000100:00100000:3.0:1787583113.169652:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787583113.169661:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435863168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169713:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435863168:12345-0@lo:400:kworker.0 Request processed in 54us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.169720:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787583113.169736:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787583113.169742:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435863680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169766:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435863680:12345-0@lo:400:kworker.0 Request processed in 25us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.169772:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787583113.169781:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787583113.169787:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435864192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169813:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435864192:12345-0@lo:400:kworker.0 Request processed in 26us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.169818:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787583113.169829:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787583113.169835:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435863424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169889:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435863424:12345-0@lo:400:kworker.0 Request processed in 54us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.169894:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787583113.169906:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787583113.169912:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435863808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169948:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435863808:12345-0@lo:400:kworker.0 Request processed in 36us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.169954:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787583113.169965:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787583113.169972:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435864320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.169996:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435864320:12345-0@lo:400:kworker.0 Request processed in 25us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.170001:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787583113.170028:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435863040 00000100:00100000:3.0:1787583113.170031:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435863040 00000100:00100000:3.0:1787583113.170057:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787583113.170063:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909345379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435863040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170090:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909345379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435863040:12345-0@lo:400:kworker.0 Request processed in 27us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.170096:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787583113.170134:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435864064 00000100:00100000:3.0:1787583113.170138:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435864064 00000100:00100000:3.0:1787583113.170156:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435864576 00000100:00100000:3.0:1787583113.170158:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435864576 00000100:00100000:3.0:1787583113.170169:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435863936 00000100:00100000:3.0:1787583113.170171:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435863936 00000100:00100000:3.0:1787583113.170179:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435864448 00000100:00100000:3.0:1787583113.170181:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435864448 00000100:00100000:3.0:1787583113.170191:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787583113.170197:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435864064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170226:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435864064:12345-0@lo:400:kworker.0 Request processed in 30us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.170240:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787583113.170251:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787583113.170257:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435864576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170285:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435864576:12345-0@lo:400:kworker.0 Request processed in 29us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.170290:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787583113.170300:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787583113.170305:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435863936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170330:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435863936:12345-0@lo:400:kworker.0 Request processed in 25us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.170335:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787583113.170345:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787583113.170350:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435864448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170378:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435864448:12345-0@lo:400:kworker.0 Request processed in 27us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.170383:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787583113.170414:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435863552 00000100:00100000:3.0:1787583113.170418:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435863552 00000100:00100000:3.0:1787583113.170450:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435863296 00000100:00100000:3.0:1787583113.170453:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435863296 00000100:00100000:3.0:1787583113.170476:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787583113.170482:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435863552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170516:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435863552:12345-0@lo:400:kworker.0 Request processed in 34us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.170522:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787583113.170541:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787583113.170548:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435863296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170577:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435863296:12345-0@lo:400:kworker.0 Request processed in 31us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.170583:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1787583113.170599:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787583113.170604:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787583113.170606:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787583113.170641:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435863296:0@lo:400:kworker.0 00010000:00080000:3.0:1787583113.170655:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247ecb480 x1874416435863808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583113.170665:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435863808:0@lo:400:kworker.0 00010000:00080000:3.0:1787583113.170674:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247eca680 x1874416435864320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583113.170682:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435864320:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170692:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936f15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435863424:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170700:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435863936:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170708:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435864448:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170742:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435863040:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170752:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435863552:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170762:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435864064:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170772:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435864576:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170793:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435863168:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170803:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435863680:0@lo:400:kworker.0 00000100:00100000:3.0:1787583113.170812:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435864192:0@lo:400:kworker.0 00000100:00100000:1.0:1787583113.173787:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787583113.173808:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092476ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435864704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787583113.173901:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583113.173955:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435864704 00000100:00100000:1.0:1787583113.173962:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435864704 00000100:00100000:1.0:1787583113.174003:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787583113.174010:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435864704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787583113.174035:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583113.174070:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435864704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583113.174076:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787583113.174115:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092476ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435864704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787583113.174323:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787583113.174332:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435864832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787583113.174359:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583113.174395:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435864832 00000100:00100000:0.0:1787583113.174398:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435864832 00000100:00100000:0.0:1787583113.174426:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787583113.174432:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435864832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787583113.174475:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787583113.174505:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435864832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583113.174511:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787583113.174540:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435864832:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787583113.550217:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787583113.550226:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787583113.550257:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787583113.550268:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787583113.614112:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583113.658277:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583113.658452:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413774720 00000100:00100000:2.0:1787583113.658463:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413774720 00000100:00100000:2.0:1787583113.658555:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:2.0:1787583113.658585:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+13:11094:x1874416413774720:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787583113.658708:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+13:11094:x1874416413774720:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 125us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583113.658715:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00080000:3.0:1787583113.659341:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583113.665677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583113.666164:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413774848 00000100:00100000:3.0:1787583113.666175:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413774848 00000100:00100000:3.0:1787583113.666266:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:3.0:1787583113.666278:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:11094:x1874416413774848:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787583113.666392:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:11094:x1874416413774848:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 117us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.666401:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00080000:0.0:1787583113.667251:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787583113.669351:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583113.669451:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413775104 00000100:00100000:0.0:1787583113.669461:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413775104 00000100:00100000:0.0:1787583113.669523:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:0.0:1787583113.669534:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+13:11094:x1874416413775104:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787583113.669909:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:11094:x1874416413775104:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 375us (564us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787583113.669916:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1787583113.678308:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435864960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583113.678389:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583113.679425:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435864960 00000100:00100000:3.0:1787583113.679446:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435864960 00000100:00100000:3.0:1787583113.679609:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787583113.679621:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435864960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787583113.679645:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583113.679703:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435864960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583113.679711:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787583113.680232:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435864960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583114.084516:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583114.084619:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413775232 00000100:00100000:1.0:1787583114.084630:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413775232 00000100:00100000:1.0:1787583114.084746:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:1.0:1787583114.084775:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:11898:x1874416413775232:12345-192.168.203.11@tcp:101:lsof.0 00010000:00010000:1.0:1787583114.084797:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583114.084816:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6b69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4360 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583114.084907:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6b70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583114.084921:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6b70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583114.084934:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6b70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583114.084989:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787583114.084993:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787583114.085033:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6b70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583114.085056:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6b69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4360 expref: 7 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583114.085073:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6b70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4360 expref: 6 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583114.085082:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013e00) 00010000:00010000:1.0:1787583114.085085:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787583114.085089:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53000, rc 0) 00000100:00100000:1.0:1787583114.085142:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+6:11898:x1874416413775232:12345-192.168.203.11@tcp:101:lsof.0 Request processed in 371us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583114.085158:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00080000:0.0:1787583114.085801:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787583114.638029:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583115.662084:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583116.050423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583116.050467:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583116.050500:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583116.050540:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583116.050564:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583116.050581:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583116.050612:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583116.050646:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413775360 00000100:00100000:2.0:1787583116.050655:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413775360 00000100:00100000:2.0:1787583116.050701:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 383 00000100:00100000:2.0:1787583116.050711:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934537a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2404:x1874416413775360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583116.051115:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934537a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2404:x1874416413775360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 405us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583116.051124:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 383 00000100:00100000:1.0:1787583116.051423:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413775488 00000100:00100000:1.0:1787583116.051430:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413775488 00000100:00100000:1.0:1787583116.051485:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 299 00000100:00100000:1.0:1787583116.051493:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:2404:x1874416413775488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583116.051536:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:2404:x1874416413775488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 45us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583116.051543:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 299 00000100:00100000:1.0:1787583116.051554:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413776000 00000100:00100000:1.0:1787583116.051558:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413776000 00000100:00100000:1.0:1787583116.051572:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413775616 00000100:00100000:1.0:1787583116.051574:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413775616 00000100:00100000:1.0:1787583116.051585:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413776128 00000100:00100000:1.0:1787583116.051587:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413776128 00000100:00100000:1.0:1787583116.051600:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 300 00000100:00100000:1.0:1787583116.051606:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+6:2404:x1874416413776000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583116.051643:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+6:2404:x1874416413776000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583116.051648:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 300 00000100:00100000:1.0:1787583116.051660:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 301 00000100:00100000:1.0:1787583116.051666:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413775616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583116.051688:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413775616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583116.051694:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 301 00000100:00100000:1.0:1787583116.051804:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 302 00000100:00100000:1.0:1787583116.051828:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2404:x1874416413776128:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583116.051879:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2404:x1874416413776128:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 52us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583116.051886:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 302 00000100:00080000:2.0:1787583116.052720:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583116.052725:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787583116.053135:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413775744 00000100:00100000:3.0:1787583116.053151:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413775744 00000100:00100000:0.0:1787583116.053265:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413775872 00000100:00100000:0.0:1787583116.053270:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413775872 00000100:00100000:3.0:1787583116.053341:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:3.0:1787583116.053350:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413775744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583116.053403:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2404:x1874416413775744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 54us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583116.053410:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00080000:2.0:1787583116.055505:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787583116.055514:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583116.055681:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:0.0:1787583116.055694:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413775872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583116.055784:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413775872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 92us (5199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583116.055809:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:1.0:1787583116.238293:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435865088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583116.238378:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583116.240084:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435865088 00000100:00100000:3.0:1787583116.240099:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435865088 00000100:00100000:3.0:1787583116.240162:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787583116.240172:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435865088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787583116.240223:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787583116.240306:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435865088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583116.240313:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787583116.242548:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435865088:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787583116.686802:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583117.262565:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435865216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583117.262688:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435865344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583117.262984:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583117.263790:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435865344 00000100:00100000:1.0:1787583117.263800:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435865344 00000100:00100000:1.0:1787583117.263892:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787583117.263903:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435865344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787583117.263934:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787583117.264001:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435865344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583117.264009:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787583117.264033:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435865344:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787583117.266175:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787583117.267237:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583117.267486:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435865216 00000100:00100000:0.0:1787583117.267494:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435865216 00000100:00100000:0.0:1787583117.267563:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787583117.267573:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435865216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787583117.267705:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:2.0:1787583117.267805:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583117.268307:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435865216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 734us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583117.268315:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787583117.269951:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435865216:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787583117.465638:0:14520:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:51:54 (1787583114) 00010000:00010000:0.0:1787583117.709999:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787583117.778418:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1787583117.778437:0:6506:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1787583117.778511:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787583117.778522:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787583118.286155:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787583118.286183:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435865472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583118.286254:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583118.286331:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435865856:0@lo:400:kworker.0 00000100:00100000:3.0:1787583118.286361:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583118.286383:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435866368:0@lo:400:kworker.0 00000100:00100000:3.0:1787583118.286432:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583118.286484:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435865472 00000100:00100000:1.0:1787583118.286494:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435865472 00000100:00100000:2.0:1787583118.286604:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435865728:0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.286699:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583118.286731:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435866240:0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.286756:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583118.286774:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435866752:0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.286795:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583118.286816:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787583118.286821:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435865600:0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.286875:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583118.286899:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435866112:0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.286944:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583118.286967:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435866624:0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.286989:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583118.287008:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fdbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435867136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583118.287032:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583118.287064:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435865728 00000100:00100000:2.0:1787583118.287069:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435865728 00000100:00100000:2.0:1787583118.287095:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435866240 00000100:00100000:2.0:1787583118.287098:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435866240 00000100:00100000:2.0:1787583118.287120:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435866752 00000100:00100000:2.0:1787583118.287123:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435866752 00000100:00100000:2.0:1787583118.287138:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435866112 00000100:00100000:2.0:1787583118.287147:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435866112 00000100:00100000:2.0:1787583118.287164:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435866624 00000100:00100000:2.0:1787583118.287167:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435866624 00000100:00100000:2.0:1787583118.287183:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787583118.287192:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435865728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.287243:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435865728:12345-0@lo:400:kworker.0 Request processed in 52us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583118.287250:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787583118.287270:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787583118.287276:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435866240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.287304:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435866240:12345-0@lo:400:kworker.0 Request processed in 29us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583118.287309:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787583118.287321:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787583118.287327:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435866752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.287354:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435866752:12345-0@lo:400:kworker.0 Request processed in 27us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583118.287359:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787583118.287372:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787583118.287378:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435866112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.287417:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435866112:12345-0@lo:400:kworker.0 Request processed in 40us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583118.287423:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787583118.287435:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787583118.287441:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435866624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.287467:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435866624:12345-0@lo:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583118.287479:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787583118.287505:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435865600 00000100:00100000:2.0:1787583118.287508:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435865600 00000100:00100000:2.0:1787583118.287531:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787583118.287537:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937702bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435865600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.287565:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937702bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435865600:12345-0@lo:400:kworker.0 Request processed in 29us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583118.287571:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787583118.287604:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435867136 00000100:00100000:2.0:1787583118.287608:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435867136 00000100:00100000:3.0:1787583118.292313:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435866880:0@lo:400:kworker.0 00000100:00100000:3.0:1787583118.292382:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583118.292432:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787583118.292440:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435865984:0@lo:400:kworker.0 00000100:00100000:3.0:1787583118.292467:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583118.292488:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435866496:0@lo:400:kworker.0 00000100:00100000:3.0:1787583118.292509:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583118.292817:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435865856 00000100:00100000:1.0:1787583118.292825:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435865856 00000100:00100000:1.0:1787583118.292875:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787583118.292886:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435865472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787583118.292919:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787583118.292980:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435865472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (6726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583118.293006:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787583118.293022:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787583118.293028:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435865856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583118.293061:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435865856:12345-0@lo:400:kworker.0 Request processed in 34us (6701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583118.293067:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1787583118.293129:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787583118.293134:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787583118.293137:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787583118.293165:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435865600:0@lo:400:kworker.0 00000100:00100000:1.0:1787583118.293182:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435866112:0@lo:400:kworker.0 00000100:00100000:1.0:1787583118.293193:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435866624:0@lo:400:kworker.0 00000100:00100000:1.0:1787583118.293204:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435865728:0@lo:400:kworker.0 00010000:00080000:1.0:1787583118.293216:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909351690700 x1874416435866240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583118.293225:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435866240:0@lo:400:kworker.0 00010000:00080000:1.0:1787583118.293235:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909348841f80 x1874416435866752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583118.293243:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435866752:0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.298582:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787583118.298608:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435867136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787583118.298645:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583118.298760:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435867136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (11726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583118.298767:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787583118.298835:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fdbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435867136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583118.298903:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435865984 00000100:00100000:2.0:1787583118.298910:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435865984 00000100:00100000:2.0:1787583118.301968:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787583118.301992:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435865984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.302086:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435865984:12345-0@lo:400:kworker.0 Request processed in 107us (9617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583118.302093:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787583118.303371:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435867008:0@lo:400:kworker.0 00000100:00100000:3.0:1787583118.303433:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583118.314077:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435866368 00000100:00100000:1.0:1787583118.314093:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435866368 00000100:00100000:1.0:1787583118.314144:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435866880 00000100:00100000:1.0:1787583118.314148:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435866880 00000100:00080000:1.0:1787583118.314192:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787583118.314210:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435866496 00000100:00100000:1.0:1787583118.314214:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435866496 00000100:00100000:1.0:1787583118.314223:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435867008 00000100:00100000:1.0:1787583118.314225:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435867008 00000100:00100000:1.0:1787583118.314244:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787583118.314254:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435866368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583118.314331:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435866368:12345-0@lo:400:kworker.0 Request processed in 79us (27899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583118.314338:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787583118.314356:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787583118.314363:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435866880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583118.314392:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435866880:12345-0@lo:400:kworker.0 Request processed in 31us (22010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583118.314397:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787583118.314422:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787583118.314428:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435866496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583118.314456:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435866496:12345-0@lo:400:kworker.0 Request processed in 28us (21945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583118.314460:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787583118.314470:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787583118.314475:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435867008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583118.314521:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435867008:12345-0@lo:400:kworker.0 Request processed in 45us (11087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583118.314527:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787583118.318157:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435867008:0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.318203:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435866368:0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.318213:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435866880:0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.318224:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435865856:0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.318244:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435865472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583118.318280:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092477dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435865984:0@lo:400:kworker.0 00000100:00100000:2.0:1787583118.318304:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435866496:0@lo:400:kworker.0 00010000:00010000:0.0:1787583118.736261:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583118.743012:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583118.747522:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413776384 00000100:00100000:2.0:1787583118.747538:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413776384 00000100:00100000:2.0:1787583118.747645:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:2.0:1787583118.747666:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+13:12165:x1874416413776384:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583118.747687:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583118.747708:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6b77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4367 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.747798:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b7e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.747811:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.747822:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.747836:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6b85 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.747892:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6b85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.747900:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6b85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.747994:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6b8c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748003:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6b8c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748009:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6b8c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583118.748019:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787583118.748112:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748119:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b7e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748126:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b7e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748131:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481c00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583118.748136:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b7e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748142:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b7e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748165:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90937e015600) 00010000:00010000:2.0:1787583118.748168:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583118.748172:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b7e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748179:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6b7e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787583118.748186:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787583118.748194:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6b85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748200:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6b85 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748206:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6b85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748211:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583118.748214:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6b85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748220:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6b85 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748226:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff909343053600) 00010000:00010000:2.0:1787583118.748228:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583118.748231:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6b85 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748237:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6b85 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748522:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6b77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4367 expref: 16 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748536:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6b8c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4367 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.748544:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90937e015500) 00010000:00010000:2.0:1787583118.748546:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583118.748549:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480a00, rc 0) 00000100:00100000:2.0:1787583118.748628:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:12165:x1874416413776384:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 965us (5625us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787583118.748635:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:1.0:1787583118.761512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583118.761606:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413776512 00000100:00100000:2.0:1787583118.761616:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413776512 00000100:00100000:2.0:1787583118.761696:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1787583118.761707:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:2404:x1874416413776512:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583118.761721:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583118.761745:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6b8c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4367 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583118.761763:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90937e015500) 00010000:00010000:2.0:1787583118.761779:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583118.761834:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:2404:x1874416413776512:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 129us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583118.761842:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1787583118.765081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583118.765128:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413776640 00000100:00100000:2.0:1787583118.765138:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413776640 00000100:00100000:2.0:1787583118.765200:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:2.0:1787583118.765210:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:12165:x1874416413776640:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787583118.765321:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:12165:x1874416413776640:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 112us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583118.765329:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:1.0:1787583118.781154:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583118.786403:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413776768 00000100:00100000:2.0:1787583118.786419:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413776768 00000100:00100000:2.0:1787583118.786814:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00100000:2.0:1787583118.786826:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:12165:x1874416413776768:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787583118.786967:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:12165:x1874416413776768:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 143us (5822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583118.786975:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00080000:1.0:1787583118.797574:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787583118.798198:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787583118.798229:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435867264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583118.798309:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583118.798574:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435867264 00000100:00100000:3.0:1787583118.798583:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435867264 00000100:00100000:3.0:1787583118.798637:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787583118.798647:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435867264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787583118.798669:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583118.798745:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435867264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583118.798752:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787583118.798842:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435867264:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1787583119.182571:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787583119.694013:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787583119.694021:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787583119.694510:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787583119.694520:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787583119.761736:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583120.564693:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583120.565567:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413776896 00000100:00100000:1.0:1787583120.565578:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413776896 00000100:00100000:1.0:1787583120.565654:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 153 00000100:00100000:1.0:1787583120.565665:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:12207:x1874416413776896:12345-192.168.203.11@tcp:101:lfs.0 00000100:00080000:0.0:1787583120.567154:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787583120.567241:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583120.567340:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6b9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c436e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.567435:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6ba1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.567451:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.567466:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.567483:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6ba8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.567491:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.567499:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568055:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568064:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6ba1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568071:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568077:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583120.568081:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568088:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6ba1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568100:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013e00) 00010000:00010000:1.0:1787583120.568103:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583120.568107:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6ba1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568113:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6ba1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568125:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568131:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6ba8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568137:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568149:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583120.568152:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568159:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568167:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90935a4d4900) 00010000:00010000:1.0:1787583120.568170:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583120.568173:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6ba8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568180:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6ba8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568218:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6b9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c436e expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568229:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013e00) 00010000:00010000:1.0:1787583120.568232:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583120.568236:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6b9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c436e expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.568246:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52800, rc 0) 00000100:00100000:1.0:1787583120.568377:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:12207:x1874416413776896:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 2713us (3841us total) trans 0 rc 301/301 00000100:00100000:1.0:1787583120.568396:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 153 00000100:00100000:1.0:1787583120.585234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583120.586013:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413777152 00000100:00100000:0.0:1787583120.586024:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413777152 00000100:00100000:0.0:1787583120.586089:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 154 00000100:00100000:0.0:1787583120.586101:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:12207:x1874416413777152:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:0.0:1787583120.586157:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583120.586185:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b64ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4192 expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.586203:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013e00) 00010000:00010000:0.0:1787583120.586215:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787583120.586290:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.586305:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6b70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4360 expref: 5 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.586314:0:7748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.586350:0:7748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6b70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4360 expref: 5 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.586364:0:7748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6b70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4360 expref: 5 pid: 6528 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583120.586379:0:7748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435867392:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583120.586489:0:7748:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247d4ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583120.587959:0:7748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435867392:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583120.587987:0:7748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583120.588526:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583120.588887:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413777280 00000100:00100000:0.0:1787583120.588895:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413777280 00010000:00010000:0.0:1787583120.588944:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6b70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4360 expref: 6 pid: 6528 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583120.588980:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00080000:3.0:1787583120.588986:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787583120.588989:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b124cdab-8363-4433-96a8-2d8722f1634b+6:2407:x1874416413777280:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583120.589013:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583120.589020:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6b70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4360 expref: 6 pid: 6528 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.589040:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6b70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4360 expref: 6 pid: 6528 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.589061:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6b70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4360 expref: 6 pid: 6528 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.589082:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013e00) 00010000:00010000:0.0:1787583120.589087:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.589096:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.589103:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.589135:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583120.589182:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413777280:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 193us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583120.589190:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00010000:00010000:3.0:1787583120.589330:0:7748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.589349:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.589370:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6bb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.589379:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.589399:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590085:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6bbd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590096:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6bbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590104:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6bbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787583120.590119:0:7748:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe3b95e1 reply state 0000000017949a3b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6bbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590128:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6bbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590134:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:3.0:1787583120.590136:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787583120.590139:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787583120.590144:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787583120.590158:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590164:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590171:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590176:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583120.590180:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590187:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590196:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013e00) 00010000:00010000:3.0:1787583120.590199:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583120.590202:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590213:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6baf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787583120.590229:0:7748:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe3b95e1 reply state 0000000017949a3b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590237:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6bb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.590242:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90937e3be400) 00010000:00010000:3.0:1787583120.590244:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787583120.590264:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787583120.590398:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:12207:x1874416413777152:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 4287us (5161us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787583120.590406:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 154 00000100:00100000:1.0:1787583120.659274:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583120.659368:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413777408 00000100:00100000:0.0:1787583120.659379:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413777408 00000100:00100000:0.0:1787583120.659452:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:0.0:1787583120.659463:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+15:12215:x1874416413777408:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:0.0:1787583120.659508:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583120.659530:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6bc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4375 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.659593:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6bcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.659619:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6bcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.659631:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6bcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583120.659678:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787583120.659682:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583120.659702:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6bcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.659726:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6bc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4375 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.659745:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6bcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4375 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.659755:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013400) 00010000:00010000:0.0:1787583120.659758:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583120.659762:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713ec00, rc 0) 00000100:00100000:0.0:1787583120.659827:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:12215:x1874416413777408:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 366us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583120.659834:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:0.0:1787583120.720260:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583120.720333:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413777536 00000100:00100000:1.0:1787583120.720343:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413777536 00000100:00100000:1.0:1787583120.720428:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:1.0:1787583120.720439:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+16:12221:x1874416413777536:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1787583120.720456:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583120.720476:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6bd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c437c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720540:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6bd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720554:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6bd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720565:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6bd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720575:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6be0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720582:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6be0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720589:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6be0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720664:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6be7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720673:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6be7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720697:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6be7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583120.720732:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787583120.720737:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787583120.720757:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6be7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720769:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6bd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720775:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6bd9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720782:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6bd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720789:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583120.720793:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6bd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720800:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6bd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720812:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013400) 00010000:00010000:1.0:1787583120.720815:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583120.720820:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6bd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720826:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6bd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720881:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6be0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720888:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6be0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720894:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6be0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720899:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583120.720901:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6be0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720908:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6be0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720917:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90937e3be400) 00010000:00010000:1.0:1787583120.720920:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583120.720923:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6be0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720928:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6be0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.720952:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6bd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c437c expref: 18 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.721144:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6be7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c437c expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.721164:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:1.0:1787583120.721166:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787583120.721169:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53600, rc 0) 00000100:00100000:1.0:1787583120.721269:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+17:12221:x1874416413777536:12345-192.168.203.11@tcp:101:bash.0 Request processed in 831us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583120.721276:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:2.0:1787583120.730482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583120.730944:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413777792 00000100:00100000:3.0:1787583120.730954:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413777792 00000100:00100000:3.0:1787583120.731007:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:3.0:1787583120.731017:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+17:12221:x1874416413777792:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1787583120.731038:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583120.731058:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6bee lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4383 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.731154:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6bf5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.731168:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.731179:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.731239:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6bfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.731247:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.731254:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787583120.731805:0:7748:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787583120.732109:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6c03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732121:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6c03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732129:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6c03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732163:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732170:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6bf5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732177:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6bf5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732184:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583120.732188:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6bf5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732195:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6bf5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732207:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:3.0:1787583120.732210:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583120.732214:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6bf5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732219:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6bf5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787583120.732241:0:7748:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033986566 reply state 000000007e9b099d transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732252:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6bfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732258:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90937e3be300) 00010000:00010000:3.0:1787583120.732261:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787583120.732263:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787583120.732296:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6bee lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4383 expref: 20 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732311:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6c03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4383 expref: 19 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.732317:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90937e3be200) 00010000:00010000:3.0:1787583120.732320:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787583120.732322:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344decc00, rc 0) 00000100:00100000:3.0:1787583120.732440:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:12221:x1874416413777792:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1423us (1966us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1787583120.732449:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:2.0:1787583120.739240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583120.740252:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413777920 00000100:00100000:1.0:1787583120.740263:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413777920 00000100:00100000:1.0:1787583120.741162:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:1.0:1787583120.741175:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413777920:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1787583120.741191:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583120.741210:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006317b11f/0x19a47956376b6c11 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c438a expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787583120.741234:0:8444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787583120.741253:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787583120.741257:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583120.741266:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006317b11f/0x19a47956376b6c11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c438a expref: 6 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.741284:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006317b11f/0x19a47956376b6c11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c438a expref: 6 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583120.741298:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52800, rc 0) 00000100:00100000:1.0:1787583120.741370:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413777920:12345-192.168.203.11@tcp:101:bash.0 Request processed in 190us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583120.741403:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00080000:3.0:1787583120.742518:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583120.748486:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583120.749654:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413778048 00000100:00100000:2.0:1787583120.749668:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413778048 00000100:00100000:2.0:1787583120.749741:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:2.0:1787583120.749752:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:12221:x1874416413778048:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1787583120.749774:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583120.749794:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4391 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.749826:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006317b11f/0x19a47956376b6c11 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c438a expref: 7 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.749891:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583120.749896:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583120.749903:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.749939:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006317b11f/0x19a47956376b6c11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c438a expref: 7 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.749953:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006317b11f/0x19a47956376b6c11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c438a expref: 7 pid: 8444 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583120.749968:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8445:1874416435867520:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583120.750075:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246773900 going to sleep for 11 seconds 00000100:00100000:0.0:1787583120.752530:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8445:1874416435867520:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583120.752563:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.752586:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480a00, rc 0) 00000100:00100000:0.0:1787583120.752652:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:12221:x1874416413778048:12345-192.168.203.11@tcp:101:bash.0 Request processed in 2901us (4174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583120.752661:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:1.0:1787583120.754190:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583120.756174:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413778176 00000100:00100000:0.0:1787583120.756187:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413778176 00010000:00010000:0.0:1787583120.756236:0:13742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006317b11f/0x19a47956376b6c11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c438a expref: 7 pid: 8444 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583120.756285:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:0.0:1787583120.756297:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413778176:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583120.756313:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583120.756335:0:13742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006317b11f/0x19a47956376b6c11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c438a expref: 7 pid: 8444 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.756351:0:13742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006317b11f/0x19a47956376b6c11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c438a expref: 7 pid: 8444 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.756577:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006317b11f/0x19a47956376b6c11 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c438a expref: 7 pid: 8444 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.756625:0:13742:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583120.756630:0:13742:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583120.756646:0:13742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.756657:0:13742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.756706:0:13742:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583120.756726:0:13742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13742:1874416435867648:192.168.203.11@tcp:105: 00000100:00100000:0.0:1787583120.756816:0:13742:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247d4ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583120.766789:0:13742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13742:1874416435867648:192.168.203.11@tcp:105: 00010000:00010000:0.0:1787583120.766816:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583120.766898:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413778176:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 10602us (12713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583120.766909:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:2.0:1787583120.768069:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583120.768150:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413778432 00000100:00100000:0.0:1787583120.768158:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413778432 00000100:00100000:0.0:1787583120.768210:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:0.0:1787583120.768220:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:12221:x1874416413778432:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:0.0:1787583120.768632:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:12221:x1874416413778432:12345-192.168.203.11@tcp:35:bash.0 Request processed in 411us (566us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787583120.768666:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00010000:00010000:2.0:1787583120.782512:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583120.883895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583120.883982:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413778688 00000100:00100000:0.0:1787583120.883992:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413778688 00000100:00100000:0.0:1787583120.884056:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 158 00000100:00100000:0.0:1787583120.884067:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:12231:x1874416413778688:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583120.884090:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583120.884110:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4398 expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583120.884208:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787583120.884310:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c1f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4398 expref: 23 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.884325:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013400) 00010000:00010000:0.0:1787583120.884327:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787583120.884332:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4398 expref: 23 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.884344:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fa00, rc 0) 00000100:00100000:0.0:1787583120.884424:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:12231:x1874416413778688:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 358us (583us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1787583120.884431:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 158 00000100:00100000:1.0:1787583120.887835:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583120.887980:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413778944 00000100:00100000:3.0:1787583120.887989:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413778944 00000100:00100000:3.0:1787583120.888048:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:3.0:1787583120.888057:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:12231:x1874416413778944:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1787583120.888270:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:12231:x1874416413778944:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 213us (443us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787583120.888293:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:1.0:1787583120.975308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583120.975425:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413779072 00000100:00100000:2.0:1787583120.975436:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413779072 00000100:00100000:2.0:1787583120.975501:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 159 00000100:00100000:2.0:1787583120.975512:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:12237:x1874416413779072:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583120.975534:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583120.975553:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6c2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c439f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.975617:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6c34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.975658:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.975673:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583120.975730:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787583120.975735:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583120.975756:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.975784:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6c2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c439f expref: 25 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.975803:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c439f expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.975811:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583120.975814:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787583120.975817:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481400, rc 0) 00000100:00100000:2.0:1787583120.975919:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:12237:x1874416413779072:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 409us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583120.975927:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 159 00000100:00100000:1.0:1787583120.984129:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583120.984268:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413779328 00000100:00100000:3.0:1787583120.984279:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413779328 00000100:00100000:3.0:1787583120.984343:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 160 00000100:00100000:3.0:1787583120.984355:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:12237:x1874416413779328:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1787583120.984375:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583120.984413:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6c3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43a6 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.984521:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6c42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.984535:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6c42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.984546:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6c42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583120.984557:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787583120.984984:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6c3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43a6 expref: 27 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.985004:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6c42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43a6 expref: 26 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583120.985014:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90937e3be200) 00010000:00010000:3.0:1787583120.985017:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787583120.985021:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344deda00, rc 0) 00000100:00100000:3.0:1787583120.985109:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+26:12237:x1874416413779328:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 756us (988us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1787583120.985118:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 160 00000100:00100000:1.0:1787583120.988402:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583120.988549:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413779584 00000100:00100000:2.0:1787583120.988559:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413779584 00000100:00100000:2.0:1787583120.988630:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:2.0:1787583120.988641:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+26:12237:x1874416413779584:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583120.988663:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583120.988708:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6c50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43ad expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.988825:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6c57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.988839:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6c57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.988892:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6c57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583120.988905:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787583120.989008:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6c50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43ad expref: 29 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.989028:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6c57 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43ad expref: 28 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583120.989037:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90937e3be200) 00010000:00010000:2.0:1787583120.989040:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787583120.989044:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481800, rc 0) 00000100:00100000:2.0:1787583120.989101:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+28:12237:x1874416413779584:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 462us (718us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1787583120.989108:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:1.0:1787583120.990456:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583120.990527:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413779712 00000100:00100000:0.0:1787583120.990534:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413779712 00000100:00100000:0.0:1787583120.990589:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1787583120.990610:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+28:2406:x1874416413779712:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583120.990647:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583120.990667:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6c42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43a6 expref: 28 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583120.990694:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90937e3be200) 00010000:00010000:0.0:1787583120.990698:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583120.990755:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:2406:x1874416413779712:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 157us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583120.990762:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1787583121.008837:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.009997:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413779840 00000100:00100000:2.0:1787583121.010009:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413779840 00000100:00100000:2.0:1787583121.010115:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1787583121.010128:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2405:x1874416413779840:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:2.0:1787583121.010186:0:8752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.010206:0:8752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.010214:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787583121.010219:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787583121.010224:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.010260:0:8752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.010274:0:8752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 6 pid: 8445 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583121.010289:0:8752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8752:1874416435867776:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583121.010398:0:8752:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246773900 going to sleep for 11 seconds 00000100:00100000:1.0:1787583121.016088:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.016217:0:8752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8752:1874416435867776:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583121.016243:0:8752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583121.016316:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413779968 00000100:00100000:3.0:1787583121.016324:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413779968 00002000:00100000:3.0:1787583121.016372:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff909247f34700 x1874416413779968/t0(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:587/0 lens 504/0 e 0 to 0 dl 1787583132 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787583121.016393:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff909247f34700 with x1874416413779968 ext(0->12) 00010000:00010000:3.0:1787583121.016401:0:8450:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 7 pid: 8445 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.016416:0:8450:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 7 pid: 8445 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787583121.016424:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff909247f34700 00000100:00100000:3.0:1787583121.016454:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1787583121.016464:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413779968:12345-192.168.203.11@tcp:4:lfs.0 00000100:00100000:3.0:1787583121.018021:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413779968:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 1550us (1934us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787583121.018032:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00002000:00100000:3.0:1787583121.018042:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff909247f34700 x1874416413779968/t4294967306(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:587/0 lens 504/448 e 0 to 0 dl 1787583132 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787583121.018052:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff909247f34700 with x1874416413779968 ext(0->12) 00010000:00010000:3.0:1787583121.018061:0:8450:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 9 pid: 8445 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.018087:0:8450:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 9 pid: 8445 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787583121.018095:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff909247f34700 00000100:00100000:3.0:1787583121.022304:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583121.022420:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413780096 00000100:00100000:0.0:1787583121.022431:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413780096 00010000:00010000:0.0:1787583121.022472:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 9 pid: 8445 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583121.022516:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:0.0:1787583121.022526:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413780096:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583121.022542:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787583121.022566:0:8470:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787583121.022570:0:8470:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787583119 00002000:00010000:0.0:1787583121.022572:0:8470:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787583119 00002000:00010000:0.0:1787583121.022574:0:8470:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787583119 00002000:00010000:0.0:1787583121.022577:0:8470:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787583121.022583:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 9 pid: 8445 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.022610:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 9 pid: 8445 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.022659:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007de71337/0x19a47956376b6c18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4391 expref: 9 pid: 8445 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.022685:0:8470:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583121.022690:0:8470:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583121.022695:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.022705:0:8470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.022748:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583121.022899:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2407:x1874416413780096:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 373us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583121.022908:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 83 00010000:00010000:3.0:1787583121.023131:0:8752:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.023142:0:8752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.023161:0:8752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.023169:0:8752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.023177:0:8752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.023184:0:8752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481c00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583121.023188:0:8752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.023196:0:8752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.023218:0:8752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.023225:0:8752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094c7483d/0x19a47956376b6c65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583121.023275:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2405:x1874416413779840:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 13150us (14447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583121.023283:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:1.0:1787583121.027259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583121.027413:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413780352 00000100:00100000:3.0:1787583121.027423:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413780352 00000100:00100000:3.0:1787583121.027475:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:3.0:1787583121.027485:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:12237:x1874416413780352:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:3.0:1787583121.027544:0:6531:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6c57 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43ad expref: 27 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787583121.028094:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1787583121.028130:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787583121.028465:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1787583121.028503:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.028520:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6c03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4383 expref: 31 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.028530:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.028576:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6c03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4383 expref: 31 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.028590:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6c03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4383 expref: 31 pid: 7748 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583121.028735:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6531:1874416435867904:192.168.203.11@tcp:104: 00000100:00100000:3.0:1787583121.028992:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91180 going to sleep for 11 seconds 00000100:00100000:1.0:1787583121.035881:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583121.037033:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413780480 00000100:00100000:0.0:1787583121.037046:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413780480 00010000:00010000:0.0:1787583121.037093:0:13742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6c03 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4383 expref: 32 pid: 7748 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583121.037144:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:0.0:1787583121.037155:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:2407:x1874416413780480:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583121.037170:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583121.037177:0:13742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6c03 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4383 expref: 32 pid: 7748 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.037211:0:13742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6c03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4383 expref: 32 pid: 7748 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.037232:0:13742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90937e3be200) 00010000:00010000:0.0:1787583121.037237:0:13742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.037246:0:13742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.037253:0:13742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.037271:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583121.037331:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:2407:x1874416413780480:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 178us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583121.037339:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00010000:00010000:0.0:1787583121.037421:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6c03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4383 expref: 31 pid: 7748 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583121.037437:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6531:1874416435867904:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583121.037457:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.037466:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.037472:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787583121.037585:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1787583121.037829:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1787583121.037955:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874416435868032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787583121.038005:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583121.038031:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247d4ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787583121.038099:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435868032 00000100:00100000:2.0:1787583121.038104:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435868032 00000100:00100000:2.0:1787583121.038144:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787583121.038159:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6531:x1874416435868032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787583121.038231:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6531:x1874416435868032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583121.038239:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:2.0:1787583121.038256:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583121.038422:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874416435868032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787583121.038524:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1787583121.038560:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874416435868160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787583121.038586:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583121.039744:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247d4e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787583121.042057:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435868160 00000100:00100000:2.0:1787583121.042170:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435868160 00000100:00100000:2.0:1787583121.042233:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787583121.042244:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6531:x1874416435868160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787583121.042498:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6531:x1874416435868160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 255us (3910us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787583121.042506:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787583121.050006:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874416435868160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787583121.050097:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1787583121.050152:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.050164:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.050172:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.050178:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583121.050182:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.050189:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.050223:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90937e3be200) 00010000:00010000:0.0:1787583121.050225:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787583121.050231:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.050237:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6c6c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787583121.050349:0:6531:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787583121.050421:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1787583121.050433:0:6531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 428203586365ns, next at 429203584388ns, rc = 0 00000001:00080000:0.0:1787583121.050439:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1787583121.050462:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90937e3be200) 00010000:00010000:0.0:1787583121.050464:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787583121.050471:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6c57 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43ad expref: 35 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583121.052762:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+34:12237:x1874416413780352:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 23109us (23342us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1787583121.052786:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000020:00080000:0.0:1787583121.052794:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787583121.062562:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583121.068287:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413780608 00000100:00100000:0.0:1787583121.068304:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413780608 00000100:00100000:2.0:1787583121.068499:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:2.0:1787583121.068511:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+34:12237:x1874416413780608:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583121.068534:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583121.068554:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6c73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.068633:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6c73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43b4 expref: 35 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.068649:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6c73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43b4 expref: 35 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.068667:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583121.068791:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787583121.068810:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481600, rc 0) 00000100:00100000:2.0:1787583121.068899:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+35:12237:x1874416413780608:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 390us (6345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583121.068906:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:1.0:1787583121.077434:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583121.077514:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413780864 00000100:00100000:0.0:1787583121.077525:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413780864 00000100:00100000:0.0:1787583121.077598:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:0.0:1787583121.077608:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+35:12237:x1874416413780864:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1787583121.077880:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+36:12237:x1874416413780864:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 273us (456us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787583121.077903:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:1.0:1787583121.165969:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583121.166020:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583121.166118:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413781248 00000100:00100000:3.0:1787583121.166128:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413781248 00000100:00100000:3.0:1787583121.166206:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:3.0:1787583121.166217:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413781248:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583121.166287:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2406:x1874416413781248:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583121.166294:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:0.0:1787583121.166429:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413780992 00000100:00100000:0.0:1787583121.166435:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413780992 00000100:00100000:0.0:1787583121.166481:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 385 00000100:00100000:0.0:1787583121.166488:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413780992:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583121.166517:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413780992:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583121.166523:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 385 00000100:00080000:2.0:1787583121.166930:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583121.171367:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583121.171414:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.174592:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413781120 00000100:00100000:2.0:1787583121.174618:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413781120 00000100:00100000:2.0:1787583121.174699:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413781376 00000100:00100000:2.0:1787583121.174702:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413781376 00000100:00100000:1.0:1787583121.176196:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 309 00000100:00100000:1.0:1787583121.176219:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413781120:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583121.176306:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413781120:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 98us (4947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583121.176314:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 309 00000100:00100000:1.0:1787583121.176338:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 310 00000100:00100000:1.0:1787583121.176346:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413781376:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583121.176371:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413781376:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (4957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583121.176405:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 310 00000100:00080000:3.0:1787583121.176878:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787583121.180231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.180560:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413781632 00000100:00100000:2.0:1787583121.180570:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413781632 00000100:00100000:2.0:1787583121.180627:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:2.0:1787583121.180637:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+36:12247:x1874416413781632:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583121.180660:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583121.180681:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6c7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43bb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583121.180786:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787583121.181503:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6c7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43bb expref: 38 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.181521:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013400) 00010000:00010000:2.0:1787583121.181524:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787583121.181529:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6c7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43bb expref: 38 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.181545:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481800, rc 0) 00000100:00100000:2.0:1787583121.181615:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+37:12247:x1874416413781632:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 980us (1393us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1787583121.181642:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:1.0:1787583121.185233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583121.185338:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413781760 00000100:00100000:0.0:1787583121.185348:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413781760 00000100:00100000:0.0:1787583121.185419:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:0.0:1787583121.185429:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+37:12247:x1874416413781760:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1787583121.185499:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c88 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185516:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185528:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185540:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6c8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185548:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185554:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185639:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6c96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185649:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6c96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185656:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6c96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787583121.185711:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6c96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185734:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185742:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185749:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185755:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fa00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583121.185759:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185767:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185778:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:0.0:1787583121.185781:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583121.185785:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185798:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b6c88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185824:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185830:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6c8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185835:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6c8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185840:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583121.185886:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6c8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185893:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6c8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185901:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90937e3be300) 00010000:00010000:0.0:1787583121.185903:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583121.185906:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6c8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185911:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6c8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185921:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6c96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185927:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6c96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185940:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6c96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185944:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583121.185948:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6c96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185953:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6c96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185960:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:0.0:1787583121.185962:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583121.185965:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6c96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.185970:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6c96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583121.186033:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+37:12247:x1874416413781760:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 604us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583121.186041:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:3.0:1787583121.196523:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583121.201159:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413782016 00000100:00100000:0.0:1787583121.201175:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413782016 00000100:00100000:0.0:1787583121.201312:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1787583121.201324:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+37:12247:x1874416413782016:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1787583121.201566:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:12247:x1874416413782016:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 244us (5051us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787583121.201574:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:1.0:1787583121.248227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583121.252093:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413782272 00000100:00100000:0.0:1787583121.252108:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413782272 00000100:00100000:1.0:1787583121.254082:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 165 00000100:00100000:1.0:1787583121.254095:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:12251:x1874416413782272:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1787583121.254121:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583121.254143:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6c9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43c2 expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254214:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ca4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254228:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ca4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254238:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ca4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254248:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6cab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254253:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6cab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254260:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6cab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254365:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6cb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254407:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254414:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583121.254424:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787583121.254502:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ca4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254510:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ca4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254517:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ca4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254524:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583121.254528:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ca4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254536:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ca4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254550:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:1.0:1787583121.254553:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583121.254558:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ca4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254565:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ca4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254578:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6cab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254590:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6cab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254596:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6cab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254601:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583121.254603:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6cab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254609:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6cab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254617:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90937e3be300) 00010000:00010000:1.0:1787583121.254619:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583121.254622:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6cab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254628:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6cab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254662:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6c9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43c2 expref: 41 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254675:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43c2 expref: 40 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.254682:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:1.0:1787583121.254685:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787583121.254693:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52800, rc 0) 00000100:00100000:1.0:1787583121.255933:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+40:12251:x1874416413782272:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1832us (7706us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787583121.255945:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 165 00000100:00100000:1.0:1787583121.264283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.264593:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413782400 00000100:00100000:2.0:1787583121.264602:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413782400 00000100:00100000:2.0:1787583121.264665:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:2.0:1787583121.264675:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+40:12251:x1874416413782400:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1787583121.264750:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.264770:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.264781:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.264820:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.264826:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cc0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.264833:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.264837:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583121.264841:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.265008:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.265019:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583121.265039:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787583121.265043:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cc0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.265049:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583121.265125:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+40:12251:x1874416413782400:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 450us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583121.265131:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:3.0:1787583121.268218:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.268351:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413782656 00000100:00100000:2.0:1787583121.268371:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413782656 00000100:00100000:2.0:1787583121.268433:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:2.0:1787583121.268443:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+40:12251:x1874416413782656:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1787583121.268733:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+41:12251:x1874416413782656:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 290us (523us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787583121.268741:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:2.0:1787583121.358202:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435868288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787583121.358280:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583121.358450:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435868288 00000100:00100000:3.0:1787583121.358459:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435868288 00000100:00100000:3.0:1787583121.358510:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787583121.358519:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435868288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787583121.358555:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787583121.358616:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435868288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583121.358639:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787583121.358734:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435868288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583121.587020:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.587103:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413782912 00000100:00100000:2.0:1787583121.587112:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413782912 00000100:00100000:2.0:1787583121.587168:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00100000:2.0:1787583121.587177:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+41:12282:x1874416413782912:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:2.0:1787583121.587199:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583121.587217:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cc7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43c9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.587331:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6cce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.587349:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6cce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.587360:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6cce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583121.587371:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787583121.587482:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cc7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43c9 expref: 44 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.587500:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6cce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43c9 expref: 43 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.587509:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583121.587511:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583121.587514:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481c00, rc 0) 00000100:00100000:2.0:1787583121.587567:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:12282:x1874416413782912:12345-192.168.203.11@tcp:101:cat.0 Request processed in 391us (556us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787583121.587574:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00100000:1.0:1787583121.593775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583121.593894:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413783040 00000100:00100000:3.0:1787583121.593905:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413783040 00000100:00100000:3.0:1787583121.593975:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:3.0:1787583121.593987:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093770b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:2406:x1874416413783040:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583121.594004:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583121.594030:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6cce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43c9 expref: 43 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583121.594051:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:3.0:1787583121.594057:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583121.594120:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093770b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+42:2406:x1874416413783040:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 136us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583121.594129:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1787583121.598958:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.599049:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413783296 00000100:00100000:2.0:1787583121.599060:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413783296 00000100:00100000:2.0:1787583121.599122:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1787583121.599133:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+42:12282:x1874416413783296:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:2.0:1787583121.599388:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:12282:x1874416413783296:12345-192.168.203.11@tcp:35:cat.0 Request processed in 256us (439us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1787583121.599397:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:1.0:1787583121.662441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.662547:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413783552 00000100:00100000:2.0:1787583121.662575:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413783552 00000100:00100000:2.0:1787583121.662651:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00100000:2.0:1787583121.662662:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:12288:x1874416413783552:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1787583121.662685:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583121.662688:0:13828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787583121.662716:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6c34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c439f expref: 43 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.662736:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583121.662741:0:13828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583121.662752:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cdc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43d0 expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.662898:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.662910:0:13828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6cb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43c2 expref: 43 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.662919:0:13828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.662953:0:13828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43c2 expref: 43 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.662967:0:13828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43c2 expref: 43 pid: 13828 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583121.662981:0:13828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435868416:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583121.663094:0:13828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092467739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583121.666737:0:13828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435868416:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583121.666765:0:13828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583121.667340:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.667498:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413783680 00000100:00100000:2.0:1787583121.667505:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413783680 00010000:00010000:2.0:1787583121.667541:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43c2 expref: 44 pid: 13828 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583121.667620:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:2.0:1787583121.667631:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+44:2406:x1874416413783680:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583121.667647:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583121.667653:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43c2 expref: 44 pid: 13828 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.667675:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43c2 expref: 44 pid: 13828 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.667698:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b6cb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43c2 expref: 44 pid: 13828 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.667712:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583121.667717:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.667726:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.667753:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.667787:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583121.667839:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:2406:x1874416413783680:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 209us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583121.667882:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00010000:00010000:1.0:1787583121.667937:0:13828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.667945:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583121.667965:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787583121.668101:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6cdc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d0 expref: 44 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.668117:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d0 expref: 43 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.668124:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:1.0:1787583121.668127:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787583121.668129:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480a00, rc 0) 00000100:00100000:1.0:1787583121.668156:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:12288:x1874416413783552:12345-192.168.203.11@tcp:101:dd.0 Request processed in 5496us (5726us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787583121.668163:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00100000:1.0:1787583121.670336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583121.670503:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413783808 00000100:00100000:0.0:1787583121.670512:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413783808 00000100:00100000:0.0:1787583121.670574:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 169 00000100:00100000:0.0:1787583121.670583:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:12288:x1874416413783808:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:0.0:1787583121.670810:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583121.670830:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6cf1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43d7 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.671000:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6cf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.671015:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.671026:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.671146:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6cf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d7 expref: 45 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.671162:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d7 expref: 44 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583121.671170:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:0.0:1787583121.671173:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787583121.671177:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f600, rc 0) 00000100:00100000:0.0:1787583121.671282:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+44:12288:x1874416413783808:12345-192.168.203.11@tcp:101:dd.0 Request processed in 699us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583121.671291:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 169 00000100:00100000:3.0:1787583121.673658:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.673989:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413784064 00000100:00100000:2.0:1787583121.673999:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413784064 00000100:00100000:2.0:1787583121.674050:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 170 00000100:00100000:2.0:1787583121.674060:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+44:12288:x1874416413784064:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:2.0:1787583121.674283:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6cff lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.674298:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6cff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.674307:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6cff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787583121.674348:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1787583121.674369:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c0563a5 reply state 000000006e980dc5 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6cff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.674392:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6cff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.674399:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583121.674402:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787583121.674422:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787583121.674525:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+47:12288:x1874416413784064:12345-192.168.203.11@tcp:36:dd.0 Request processed in 465us (875us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1787583121.674532:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 170 00000020:00080000:2.0:1787583121.674537:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787583121.806005:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583121.943623:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.943815:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413784192 00000100:00100000:2.0:1787583121.943826:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413784192 00000100:00100000:2.0:1787583121.943974:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:2.0:1787583121.943986:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+47:12302:x1874416413784192:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:2.0:1787583121.944009:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583121.944029:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43de expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.944093:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6d0d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.944105:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6d0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.944119:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6d0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.944130:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.944137:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.944144:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.944224:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.944252:0:13828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d0 expref: 48 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.944260:0:13828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d1b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.944292:0:13828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d0 expref: 48 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.944305:0:13828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d0 expref: 48 pid: 13828 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583121.944319:0:13828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435868544:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583121.944486:0:13828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092467739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583121.948201:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583121.948279:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413784448 00000100:00100000:0.0:1787583121.948289:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413784448 00000100:00100000:0.0:1787583121.948345:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:0.0:1787583121.948356:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+49:6176:x1874416413784448:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787583121.948740:0:13828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435868544:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583121.948764:0:13828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583121.951878:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+50:6176:x1874416413784448:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 3504us (3676us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787583121.951894:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1787583121.954597:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583121.954660:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413784576 00000100:00100000:2.0:1787583121.954670:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413784576 00010000:00010000:2.0:1787583121.955006:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d0 expref: 50 pid: 13828 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583121.955050:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:2.0:1787583121.955061:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+50:2407:x1874416413784576:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583121.955075:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583121.955097:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d0 expref: 50 pid: 13828 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.955110:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d0 expref: 50 pid: 13828 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.955132:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6ce3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d0 expref: 50 pid: 13828 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.955147:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583121.955151:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.955160:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.955166:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d1b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583121.955200:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583121.955244:0:13828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955255:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583121.955262:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+49:2407:x1874416413784576:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 201us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583121.955271:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000004:00200000:1.0:1787583121.955313:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787583121.955318:0:13828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787583121.955341:0:13828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955356:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955365:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6d0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955371:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6d0d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955390:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6d0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955396:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583121.955400:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6d0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955407:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6d0d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955416:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:1.0:1787583121.955425:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583121.955429:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6d0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955435:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6d0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955460:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955466:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955471:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955476:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583121.955480:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955485:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955494:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90937e3be300) 00010000:00010000:1.0:1787583121.955497:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583121.955500:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955505:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955539:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43de expref: 49 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955567:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43de expref: 48 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583121.955574:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:1.0:1787583121.955576:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787583121.955578:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481c00, rc 0) 00000100:00100000:1.0:1787583121.955617:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+48:12302:x1874416413784192:12345-192.168.203.11@tcp:101:stat.0 Request processed in 11634us (12004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583121.955624:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:1.0:1787583122.009003:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583122.009353:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413784832 00000100:00100000:0.0:1787583122.009364:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413784832 00000100:00100000:0.0:1787583122.009457:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:0.0:1787583122.009469:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+48:12308:x1874416413784832:12345-192.168.203.11@tcp:36:truncate.0 00010000:00010000:0.0:1787583122.009526:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:3.0:1787583122.009527:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787583122.009556:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43de expref: 48 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.009576:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:0.0:1787583122.009580:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787583122.009759:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6d22 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.009772:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6d22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.009781:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6d22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787583122.009840:0:7748:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1787583122.009920:0:7748:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000faa6c840 reply state 000000004cc3a554 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6d22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.009934:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6d22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.009941:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:0.0:1787583122.009943:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787583122.009946:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787583122.010041:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+50:12308:x1874416413784832:12345-192.168.203.11@tcp:36:truncate.0 Request processed in 574us (1046us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787583122.010048:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 172 00000020:00080000:0.0:1787583122.010053:0:7748:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787583122.178255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.182177:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413784960 00000100:00100000:2.0:1787583122.182193:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413784960 00000100:00100000:2.0:1787583122.182272:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:2.0:1787583122.182283:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+50:12322:x1874416413784960:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:2.0:1787583122.182333:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583122.182354:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43e5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182447:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d30 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182461:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182472:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182482:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182489:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182495:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182563:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182572:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182578:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583122.182619:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787583122.182623:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583122.182642:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182678:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182686:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182692:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d30 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182697:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182703:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481c00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583122.182706:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182713:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d30 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182725:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583122.182728:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583122.182732:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182738:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182752:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182759:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182771:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182776:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583122.182779:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182786:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182795:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90937e3be300) 00010000:00010000:2.0:1787583122.182797:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583122.182800:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d37 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182805:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182833:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43e5 expref: 52 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182893:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43e5 expref: 51 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.182901:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583122.182903:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583122.182905:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481800, rc 0) 00000100:00100000:2.0:1787583122.182979:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+51:12322:x1874416413784960:12345-192.168.203.11@tcp:101:stat.0 Request processed in 697us (4733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583122.182997:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:3.0:1787583122.285560:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583122.286781:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413785216 00000100:00100000:1.0:1787583122.286794:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413785216 00000100:00100000:1.0:1787583122.286902:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 174 00000100:00100000:1.0:1787583122.286925:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+51:12332:x1874416413785216:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1787583122.286946:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583122.286965:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6d45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43ec expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583122.287071:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787583122.287168:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6d45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43ec expref: 53 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.287183:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013400) 00010000:00010000:1.0:1787583122.287186:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787583122.287191:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6d45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43ec expref: 53 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.287226:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52400, rc 0) 00000100:00100000:1.0:1787583122.287295:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+52:12332:x1874416413785216:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 383us (1744us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1787583122.287302:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 174 00000100:00100000:0.0:1787583122.289675:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.289795:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413785472 00000100:00100000:2.0:1787583122.289804:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413785472 00000100:00100000:2.0:1787583122.289890:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:2.0:1787583122.289901:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373fa5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+52:12332:x1874416413785472:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1787583122.290107:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373fa5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+53:12332:x1874416413785472:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 208us (451us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1787583122.290115:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:3.0:1787583122.348265:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583122.348352:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413785728 00000100:00100000:0.0:1787583122.348361:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413785728 00000100:00100000:0.0:1787583122.348432:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 175 00000100:00100000:0.0:1787583122.348443:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+53:12338:x1874416413785728:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1787583122.348466:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583122.348486:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6d53 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43f3 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.348590:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.348605:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43e5 expref: 54 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.348635:0:7748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.348840:0:7748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43e5 expref: 54 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.348884:0:7748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43e5 expref: 54 pid: 6528 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583122.348898:0:7748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435868672:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583122.348995:0:7748:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787583122.353584:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.353914:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413785856 00000100:00100000:2.0:1787583122.353924:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413785856 00010000:00010000:2.0:1787583122.353966:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43e5 expref: 55 pid: 6528 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583122.354013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:2.0:1787583122.354023:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+55:2406:x1874416413785856:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583122.354038:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583122.354044:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43e5 expref: 55 pid: 6528 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.354056:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43e5 expref: 55 pid: 6528 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.354077:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583122.354082:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.354113:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.354121:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.354138:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583122.354245:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+55:2406:x1874416413785856:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 223us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583122.354253:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 87 00010000:00010000:0.0:1787583122.354469:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6d3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43e5 expref: 54 pid: 6528 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583122.354489:0:7748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435868672:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583122.354512:0:7748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.354521:0:7748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.354527:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583122.354546:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787583122.354692:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6d53 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43f3 expref: 55 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.354730:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43f3 expref: 54 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.354738:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:0.0:1787583122.354749:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787583122.354751:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e800, rc 0) 00000100:00100000:0.0:1787583122.354781:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:12338:x1874416413785728:12345-192.168.203.11@tcp:101:bash.0 Request processed in 6340us (6524us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787583122.354787:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 175 00000100:00100000:1.0:1787583122.361809:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.362128:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413786112 00000100:00100000:2.0:1787583122.362139:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413786112 00000100:00100000:2.0:1787583122.362200:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 176 00000100:00100000:2.0:1787583122.362211:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:12338:x1874416413786112:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:2.0:1787583122.362459:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.362477:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.362488:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787583122.362532:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1787583122.362554:0:6529:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e41bff6f reply state 00000000149f5134 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.362568:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.362607:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583122.362610:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787583122.362614:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787583122.362716:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+57:12338:x1874416413786112:12345-192.168.203.11@tcp:36:bash.0 Request processed in 500us (909us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1787583122.362724:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 176 00000020:00080000:2.0:1787583122.362728:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787583122.368268:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.368478:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413786240 00000100:00100000:2.0:1787583122.368489:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413786240 00000100:00100000:2.0:1787583122.368552:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:2.0:1787583122.368564:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+57:12338:x1874416413786240:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1787583122.368587:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583122.368605:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c43fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.368974:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.368990:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43f3 expref: 58 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.369000:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d76 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.369036:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43f3 expref: 58 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.369050:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43f3 expref: 58 pid: 7748 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583122.369082:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874416435868800:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583122.369167:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092467739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583122.372452:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583122.373468:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413786368 00000100:00100000:1.0:1787583122.373480:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413786368 00010000:00010000:1.0:1787583122.373525:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43f3 expref: 59 pid: 7748 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583122.373574:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:1.0:1787583122.373584:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:2407:x1874416413786368:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583122.373598:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583122.373604:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43f3 expref: 59 pid: 7748 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.373617:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43f3 expref: 59 pid: 7748 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.373637:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:1.0:1787583122.373642:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.373651:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.373676:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d76 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.373695:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583122.373982:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:2407:x1874416413786368:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 398us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583122.373990:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 88 00010000:00010000:2.0:1787583122.374217:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b6d5a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43f3 expref: 58 pid: 7748 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583122.374233:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874416435868800:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583122.374257:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.374266:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.374271:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583122.374322:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787583122.374327:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583122.374344:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.374385:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6d6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43fa expref: 58 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.374400:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43fa expref: 57 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.374407:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583122.374417:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583122.374420:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481c00, rc 0) 00000100:00100000:2.0:1787583122.374459:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+57:12338:x1874416413786240:12345-192.168.203.11@tcp:101:bash.0 Request processed in 5898us (6201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583122.374466:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:3.0:1787583122.376717:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.376876:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413786624 00000100:00100000:2.0:1787583122.376884:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413786624 00000100:00100000:2.0:1787583122.376937:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1787583122.376947:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+57:12338:x1874416413786624:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1787583122.377752:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:12338:x1874416413786624:12345-192.168.203.11@tcp:35:bash.0 Request processed in 798us (1036us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787583122.377761:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1787583122.382364:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787583122.382399:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ebb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435868928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787583122.382469:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583122.382894:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435868928 00000100:00100000:3.0:1787583122.382902:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435868928 00000100:00100000:3.0:1787583122.382973:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787583122.382993:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435868928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787583122.383023:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787583122.383073:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435868928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583122.383081:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787583122.383128:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ebb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435868928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787583122.383243:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787583122.383278:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435869056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787583122.383309:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583122.383336:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435869056 00000100:00100000:0.0:1787583122.383340:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435869056 00000100:00100000:0.0:1787583122.383365:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787583122.383383:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435869056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583122.383395:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787583122.383426:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435869056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583122.383432:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787583122.383462:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435869056:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787583122.383565:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583122.442361:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583122.442500:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413786880 00000100:00100000:0.0:1787583122.442508:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413786880 00000100:00100000:0.0:1787583122.442593:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00100000:0.0:1787583122.442604:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:12348:x1874416413786880:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583122.442643:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583122.442670:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6d7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4401 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583122.442762:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787583122.442905:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6d7d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4401 expref: 60 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.442919:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013400) 00010000:00010000:0.0:1787583122.442922:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787583122.442927:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b6d7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4401 expref: 60 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.442941:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f000, rc 0) 00000100:00100000:0.0:1787583122.443010:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:12348:x1874416413786880:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 408us (659us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1787583122.443017:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00100000:3.0:1787583122.446132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583122.446841:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413787008 00000100:00100000:1.0:1787583122.446867:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413787008 00000100:00100000:1.0:1787583122.446930:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 179 00000100:00100000:1.0:1787583122.446940:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:12348:x1874416413787008:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:1.0:1787583122.447021:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6d8b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447037:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6d8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447047:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6d8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447057:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6d92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447064:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447070:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447161:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6d99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447171:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447183:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583122.447230:0:13828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447242:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6d8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447248:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6d8b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447255:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6d8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447261:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52c00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583122.447265:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6d8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447273:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6d8b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447283:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:1.0:1787583122.447298:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583122.447302:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6d8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447315:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6d8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447327:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447333:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6d92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447339:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6d92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447345:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583122.447347:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6d92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447353:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6d92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447361:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90937e3be300) 00010000:00010000:1.0:1787583122.447363:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583122.447366:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6d92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447381:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6d92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447391:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447397:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6d99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447408:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447413:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52a00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583122.447416:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447422:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6d99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447429:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:1.0:1787583122.447432:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583122.447434:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6d99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.447440:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6d99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583122.447515:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:12348:x1874416413787008:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 575us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583122.447522:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 179 00000100:00100000:3.0:1787583122.455698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.455787:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413787264 00000100:00100000:2.0:1787583122.455799:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413787264 00000100:00100000:2.0:1787583122.455878:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1787583122.455889:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:12348:x1874416413787264:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1787583122.456107:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:12348:x1874416413787264:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 219us (417us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787583122.456114:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1787583122.495520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583122.495631:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413787520 00000100:00100000:1.0:1787583122.495642:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413787520 00000100:00100000:1.0:1787583122.495702:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:1.0:1787583122.495712:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:12351:x1874416413787520:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1787583122.495739:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583122.495763:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6da0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4408 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.495902:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6da7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.495916:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6da7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.495926:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6da7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.495936:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6dae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.495942:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6dae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.495947:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6dae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496046:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6db5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496055:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496062:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583122.496071:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787583122.496143:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6da7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496150:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6da7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496162:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6da7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496168:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583122.496172:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6da7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496179:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6da7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496192:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:1.0:1787583122.496195:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583122.496198:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6da7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496205:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6da7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496218:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6dae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496225:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6dae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496230:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6dae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496234:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52c00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583122.496237:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6dae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496253:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6dae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496261:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90937e3be300) 00010000:00010000:1.0:1787583122.496263:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583122.496266:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6dae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496272:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6dae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496308:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6da0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4408 expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496321:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4408 expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.496328:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:1.0:1787583122.496330:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787583122.496333:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53e00, rc 0) 00000100:00100000:1.0:1787583122.496401:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:12351:x1874416413787520:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 690us (890us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787583122.496408:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:1.0:1787583122.499048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583122.499141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.502065:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413787648 00000100:00100000:2.0:1787583122.502080:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413787648 00000100:00100000:2.0:1787583122.502208:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1787583122.502235:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:2406:x1874416413787648:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583122.502251:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583122.502275:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6db5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4408 expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.502295:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583122.502299:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583122.502365:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:2406:x1874416413787648:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 133us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583122.502384:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1787583122.505573:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413787776 00000100:00100000:3.0:1787583122.505588:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413787776 00000100:00100000:3.0:1787583122.505652:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:3.0:1787583122.505674:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909248468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:12351:x1874416413787776:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1787583122.505738:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6dc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.505756:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.505767:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.505802:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.505810:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6dc3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.505817:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.505858:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583122.505864:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.505873:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6dc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.505886:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:3.0:1787583122.505889:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787583122.505894:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6dc3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.505901:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6dc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583122.505987:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909248468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:12351:x1874416413787776:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 326us (6844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583122.505995:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:1.0:1787583122.510000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583122.510076:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413788032 00000100:00100000:0.0:1787583122.510085:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413788032 00000100:00100000:0.0:1787583122.510148:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:0.0:1787583122.510158:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909248469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+61:12351:x1874416413788032:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1787583122.510582:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909248469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:12351:x1874416413788032:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 424us (589us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787583122.510590:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:3.0:1787583122.673407:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.673701:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413788288 00000100:00100000:2.0:1787583122.673711:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413788288 00000100:00100000:2.0:1787583122.673774:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:2.0:1787583122.673785:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:12369:x1874416413788288:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:2.0:1787583122.673811:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583122.673832:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6dca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c440f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.673996:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dd1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.674012:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.674023:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583122.674034:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787583122.674170:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6dca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c440f expref: 65 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.674189:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c440f expref: 64 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.674198:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583122.674201:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787583122.674205:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341480e00, rc 0) 00000100:00100000:2.0:1787583122.674269:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+64:12369:x1874416413788288:12345-192.168.203.11@tcp:101:cat.0 Request processed in 486us (872us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1787583122.674277:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:0.0:1787583122.696254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.696402:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413788416 00000100:00100000:2.0:1787583122.696413:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413788416 00000100:00100000:2.0:1787583122.696485:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:2.0:1787583122.696496:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+64:12370:x1874416413788416:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583122.696521:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583122.696542:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6ddf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4416 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.696634:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6de6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.696648:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.696659:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583122.696712:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787583122.696715:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583122.696735:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.696762:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6ddf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4416 expref: 66 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.696780:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6de6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4416 expref: 65 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.696789:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583122.696792:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787583122.696795:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909341481800, rc 0) 00000100:00100000:2.0:1787583122.696915:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12370:x1874416413788416:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 420us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583122.696922:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:3.0:1787583122.702947:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.703012:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413788800 00000100:00100000:2.0:1787583122.703021:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413788800 00000100:00100000:2.0:1787583122.703077:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:2.0:1787583122.703086:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12370:x1874416413788800:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1787583122.703383:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12370:x1874416413788800:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 297us (443us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787583122.703391:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:0.0:1787583122.714118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.714229:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413788928 00000100:00100000:3.0:1787583122.714239:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413788928 00000100:00100000:3.0:1787583122.714303:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:3.0:1787583122.714315:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12370:x1874416413788928:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:3.0:1787583122.714330:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787583122.714355:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6d76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43fa expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.714406:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c440f expref: 65 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.714419:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6c73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43b4 expref: 64 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.714430:0:13742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:3.0:1787583122.714435:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583122.714498:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:12370:x1874416413788928:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 185us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583122.714505:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:1.0:1787583122.720834:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.721331:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413789056 00000100:00100000:2.0:1787583122.721342:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413789056 00000100:00100000:2.0:1787583122.721433:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:2.0:1787583122.721444:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909248469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:12370:x1874416413789056:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:2.0:1787583122.721551:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6ded lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.721568:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6ded lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.721579:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6ded lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787583122.721688:0:13828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787583122.721785:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909248469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:12370:x1874416413789056:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 342us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583122.721793:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:1.0:1787583122.748380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.748497:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413789184 00000100:00100000:2.0:1787583122.748508:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413789184 00000100:00100000:2.0:1787583122.748566:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:2.0:1787583122.748575:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:12372:x1874416413789184:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583122.748596:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583122.748617:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6df4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c441d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748679:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dfb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748694:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748705:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748723:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6e02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748731:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748737:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748812:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748822:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748828:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583122.748895:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787583122.748899:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583122.748916:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748927:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748935:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748941:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dfb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748958:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748964:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583122.748969:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748976:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dfb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.748989:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583122.748993:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583122.748997:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.749004:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480e00/0x19a47956376b6dfb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.749018:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.749024:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6e02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.749030:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6e02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.749035:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481c00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583122.749038:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6e02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.749053:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6e02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.749062:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90937e3be300) 00010000:00010000:2.0:1787583122.749063:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583122.749066:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6e02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.749071:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481c00/0x19a47956376b6e02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.749097:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481600/0x19a47956376b6df4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c441d expref: 65 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.749110:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c441d expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.749117:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583122.749119:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787583122.749121:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770ae00, rc 0) 00000100:00100000:2.0:1787583122.749349:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+64:12372:x1874416413789184:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 773us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583122.749356:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 185 00000040:00080000:3.0:1787583122.766048:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787583122.766057:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787583122.766100:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787583122.766111:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787583122.766251:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eb9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874416435869184:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787583122.766362:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787583122.777088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583122.777175:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413789312 00000100:00100000:0.0:1787583122.777185:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413789312 00000100:00100000:0.0:1787583122.777244:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:0.0:1787583122.777254:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909248468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12376:x1874416413789312:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787583122.777285:0:7748:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787583122.777423:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909248468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12376:x1874416413789312:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 169us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583122.777432:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:3.0:1787583122.777789:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eb9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874416435869184:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787583122.782709:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.782974:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413789440 00000100:00100000:3.0:1787583122.782984:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413789440 00000100:00100000:3.0:1787583122.783043:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:3.0:1787583122.783053:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+64:12376:x1874416413789440:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787583122.783122:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e10 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783158:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e10 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783169:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e10 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783186:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e17 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783193:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783200:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783228:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783238:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783245:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583122.783290:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787583122.783294:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787583122.783307:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783319:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e10 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783334:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e10 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783342:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e10 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783348:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583122.783352:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e10 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783358:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e10 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783387:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90937e015500) 00010000:00010000:3.0:1787583122.783391:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583122.783395:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e10 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783401:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e10 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783414:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783420:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e17 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783427:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e17 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783432:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583122.783439:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e17 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783446:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e17 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783454:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff90937e3be700) 00010000:00010000:3.0:1787583122.783456:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583122.783459:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e17 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783465:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e17 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783479:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783485:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783491:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783496:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344decc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583122.783499:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783505:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783510:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:3.0:1787583122.783512:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583122.783519:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.783525:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583122.783926:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+64:12376:x1874416413789440:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 871us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583122.783935:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:1.0:1787583122.797530:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.797612:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413789696 00000100:00100000:2.0:1787583122.797623:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413789696 00000100:00100000:2.0:1787583122.797685:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:2.0:1787583122.797696:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909248469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+64:12376:x1874416413789696:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583122.797734:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583122.797755:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6e25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4424 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.797896:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6e2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.797911:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.797923:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583122.797934:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787583122.798014:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.798022:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6e2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.798028:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.798034:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583122.798039:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.798047:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6e2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.798059:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583122.798068:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787583122.798073:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6e2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.798079:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6e2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.798118:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6e25 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4424 expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.798128:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90937e015500) 00010000:00010000:2.0:1787583122.798130:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787583122.798134:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6e25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4424 expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.798144:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a600, rc 0) 00000100:00100000:2.0:1787583122.798209:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909248469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12376:x1874416413789696:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 513us (686us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1787583122.798217:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:1.0:1787583122.802344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.802456:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413789824 00000100:00100000:2.0:1787583122.802467:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413789824 00000100:00100000:2.0:1787583122.802534:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:2.0:1787583122.802545:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909248468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12376:x1874416413789824:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787583122.802584:0:13828:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787583122.802708:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909248468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12376:x1874416413789824:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 164us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583122.802717:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:0.0:1787583122.814569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.814720:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413790080 00000100:00100000:3.0:1787583122.814730:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413790080 00000100:00100000:3.0:1787583122.814841:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:3.0:1787583122.814934:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12376:x1874416413790080:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787583122.814956:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583122.814960:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787583122.814987:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481800/0x19a47956376b6de6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4416 expref: 65 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.815007:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:3.0:1787583122.815012:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787583122.815024:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e3a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c442b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787583122.815390:0:6528:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787583122.815518:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.815531:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.815559:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.815800:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e3a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c442b expref: 67 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.815817:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c442b expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.815825:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3be700) 00010000:00010000:3.0:1787583122.815827:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787583122.815830:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344deda00, rc 0) 00000100:00100000:3.0:1787583122.816021:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12376:x1874416413790080:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1091us (1460us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787583122.816030:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:0.0:1787583122.825342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.825441:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413790336 00000100:00100000:3.0:1787583122.825452:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413790336 00000100:00100000:3.0:1787583122.825509:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:3.0:1787583122.825521:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12376:x1874416413790336:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787583122.825575:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583122.825602:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c442b expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825621:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3be700) 00010000:00010000:3.0:1787583122.825633:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787583122.825654:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e4f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825694:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e4f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825705:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e4f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825720:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4caa1ef8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825728:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4caa1ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825734:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4caa1ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825781:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e4f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825787:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e4f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825793:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e4f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825799:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344decc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583122.825803:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e4f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825809:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e4f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825818:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:3.0:1787583122.825827:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583122.825831:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e4f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825836:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e4f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825899:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4caa1ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825905:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e56 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4caa1ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825910:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e56 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4caa1ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825915:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dede00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583122.825917:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e56 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4caa1ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825922:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e56 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4caa1ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825929:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4caa1ef8 (ffff90937e3bef00) 00010000:00010000:3.0:1787583122.825932:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583122.825934:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e56 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4caa1ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.825945:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e56 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4caa1ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583122.826029:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12376:x1874416413790336:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 510us (697us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787583122.826042:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:1.0:1787583122.829688:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.829771:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413790464 00000100:00100000:3.0:1787583122.829781:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413790464 00000100:00100000:3.0:1787583122.829840:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:3.0:1787583122.829882:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909248469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12376:x1874416413790464:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787583122.829902:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583122.829923:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e5d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4432 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.829957:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.829969:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.829980:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.830093:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4432 expref: 67 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.830110:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4432 expref: 66 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.830119:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:3.0:1787583122.830122:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787583122.830125:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367f400, rc 0) 00000100:00100000:3.0:1787583122.830177:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909248469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12376:x1874416413790464:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 297us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583122.830203:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 192 00010000:00010000:0.0:1787583122.832528:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583122.835366:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.839974:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413790720 00000100:00100000:3.0:1787583122.839988:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413790720 00000100:00100000:3.0:1787583122.840052:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:3.0:1787583122.840064:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12376:x1874416413790720:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787583122.840143:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.840159:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.840172:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787583122.840553:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787583122.840564:0:6528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 429993717288ns, next at 430993714903ns, rc = 0 00000004:00010000:3.0:1787583122.840807:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070b66b4f reply state 00000000003c0c3d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.840821:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.840829:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:3.0:1787583122.840832:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787583122.840835:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787583122.840977:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+68:12376:x1874416413790720:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 914us (5618us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787583122.840985:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:0.0:1787583122.843031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.843112:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413790848 00000100:00100000:3.0:1787583122.843136:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413790848 00000100:00100000:3.0:1787583122.843191:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:3.0:1787583122.843202:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+68:12376:x1874416413790848:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787583122.843224:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583122.843242:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909340031a00/0x19a47956376b6e72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4439 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.843296:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909340031a00/0x19a47956376b6e72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4439 expref: 69 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.843310:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909340031a00/0x19a47956376b6e72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4439 expref: 69 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.843328:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:3.0:1787583122.843331:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787583122.843334:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909340031a00, rc 0) 00000100:00100000:3.0:1787583122.843390:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+69:12376:x1874416413790848:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 190us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583122.843397:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:3.0:1787583122.849262:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583122.849340:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413790976 00000100:00100000:0.0:1787583122.849350:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413790976 00000100:00100000:0.0:1787583122.849417:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:0.0:1787583122.849428:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+6:2407:x1874416413790976:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787583122.849666:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413790976:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 230us (404us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787583122.849675:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:0.0:1787583122.856488:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.856561:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413791232 00000100:00100000:2.0:1787583122.856589:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413791232 00000100:00100000:2.0:1787583122.856643:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1787583122.856654:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+69:12376:x1874416413791232:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787583122.856915:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+70:12376:x1874416413791232:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 262us (435us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1787583122.856922:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1787583122.865972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.866353:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413791488 00000100:00100000:3.0:1787583122.866363:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413791488 00000100:00100000:3.0:1787583122.866424:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:3.0:1787583122.866435:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+70:12376:x1874416413791488:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787583122.866545:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+70:12376:x1874416413791488:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 111us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583122.866553:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:2.0:1787583122.868618:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.868757:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413791616 00000100:00100000:3.0:1787583122.868765:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413791616 00000100:00100000:3.0:1787583122.868824:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:3.0:1787583122.868834:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+70:12376:x1874416413791616:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787583122.868883:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583122.868903:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4440 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.868994:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.869007:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.869021:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583122.869066:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787583122.869087:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.869114:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6e79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4440 expref: 72 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.869130:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4440 expref: 71 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.869138:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:3.0:1787583122.869141:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787583122.869145:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dede00, rc 0) 00000100:00100000:3.0:1787583122.869201:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+71:12376:x1874416413791616:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 369us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583122.869208:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:3.0:1787583122.872188:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.881685:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413791744 00000100:00100000:2.0:1787583122.881700:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413791744 00000100:00100000:2.0:1787583122.881801:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:2.0:1787583122.881813:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413791744:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583122.881832:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583122.881877:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6e87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4447 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787583122.881905:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c5a91, blocks: 0x0 00010000:00010000:2.0:1787583122.881924:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=430s v=(0 0) 00010000:00010000:2.0:1787583122.881929:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583122.881939:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4447 expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.881958:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4447 expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.881972:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770bc00, rc 0) 00000100:00100000:2.0:1787583122.882078:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2406:x1874416413791744:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 266us (9898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583122.882086:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:2.0:1787583122.886469:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.886536:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413792000 00000100:00100000:3.0:1787583122.886546:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413792000 00000100:00100000:3.0:1787583122.886609:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00100000:3.0:1787583122.886620:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+71:12376:x1874416413792000:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787583122.886737:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+71:12376:x1874416413792000:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 118us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583122.886745:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00100000:0.0:1787583122.902419:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.902509:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413792128 00000100:00100000:2.0:1787583122.902519:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413792128 00000100:00100000:2.0:1787583122.902579:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1787583122.902600:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:12376:x1874416413792128:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583122.902617:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583122.902635:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c444e expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.902676:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6e87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4447 expref: 9 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.902686:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583122.902690:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583122.902696:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c444e expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.902730:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4447 expref: 9 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.902743:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6e87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4447 expref: 9 pid: 8442 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583122.902756:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8444:1874416435869312:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583122.902944:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246773540 going to sleep for 11 seconds 00000100:00100000:1.0:1787583122.907837:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8444:1874416435869312:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583122.907904:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c444e expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.907925:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a800, rc 0) 00000100:00100000:1.0:1787583122.907972:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:12376:x1874416413792128:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 5374us (5563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583122.907980:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:0.0:1787583122.908695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583122.909426:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413792256 00000100:00100000:1.0:1787583122.909437:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413792256 00010000:00010000:1.0:1787583122.909477:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6e87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4447 expref: 9 pid: 8442 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583122.909519:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:1.0:1787583122.909530:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093770b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413792256:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583122.909544:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583122.909567:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6e87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4447 expref: 9 pid: 8442 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.909582:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4447 expref: 9 pid: 8442 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.909634:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6e87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4447 expref: 9 pid: 8442 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.909648:0:6513:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583122.909653:0:6513:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583122.909671:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c444e expref: 8 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.909681:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c444e expref: 8 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.909718:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c444e expref: 8 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583122.909733:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6513:1874416435869440:192.168.203.11@tcp:105: 00000100:00100000:0.0:1787583122.910136:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff909350a78c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787583122.921021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583122.921052:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413792384 00000100:00100000:1.0:1787583122.921060:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413792384 00002000:00100000:1.0:1787583122.921112:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff90924846ad80 x1874416413792384/t0(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:588/0 lens 504/0 e 0 to 0 dl 1787583133 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787583122.921123:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90924846ad80 with x1874416413792384 ext(0->8) 00002000:00010000:1.0:1787583122.921128:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90924846ad80 00000100:00100000:1.0:1787583122.921153:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1787583122.921162:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413792384:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787583122.921754:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6513:1874416435869440:192.168.203.11@tcp:105: 00010000:00010000:3.0:1787583122.921775:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583122.925361:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093770b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:2407:x1874416413792256:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 15824us (16660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583122.925384:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:0.0:1787583122.926817:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:2407:x1874416413792384:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 5648us (5799us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787583122.926863:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00002000:00100000:0.0:1787583122.926878:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff90924846ad80 x1874416413792384/t4294967315(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:588/0 lens 504/448 e 0 to 0 dl 1787583133 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787583122.926888:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90924846ad80 with x1874416413792384 ext(0->8) 00002000:00010000:0.0:1787583122.926895:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90924846ad80 00000100:00100000:3.0:1787583122.928713:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.928930:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413792512 00000100:00100000:2.0:1787583122.928938:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413792512 00000100:00100000:2.0:1787583122.929032:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 198 00000100:00100000:2.0:1787583122.929043:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+71:12376:x1874416413792512:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787583122.930646:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1787583122.930661:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1787583122.930711:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787583122.930724:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff909247d4ea80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787583122.930728:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff909377135300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff909247d4e240 00000020:00080000:1.0:1787583122.930732:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff909377135700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90924770cc00 00000100:00100000:1.0:1787583122.930841:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435869568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787583122.930916:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787583122.931018:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6bb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931030:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6bb6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931038:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6bb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931045:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583122.931050:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6bb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931058:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6bb6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931074:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90937e3be400) 00010000:00010000:2.0:1787583122.931077:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583122.931082:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6bb6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931088:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6bb6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931108:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6bbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931120:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6bbd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931127:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6bbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931132:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583122.931135:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6bbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931141:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6bbd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931150:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583122.931153:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583122.931156:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6bbd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931161:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6bbd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931175:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6bfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931182:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6bfc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931188:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6bfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931193:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583122.931200:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6bfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931207:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6bfc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931216:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90937e3be300) 00010000:00010000:2.0:1787583122.931218:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583122.931221:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6bfc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931227:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b6bfc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931243:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6cff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931249:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6cff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931255:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6cff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931261:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341481400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583122.931263:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6cff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931269:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6cff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931277:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583122.931279:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583122.931287:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6cff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931293:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341481400/0x19a47956376b6cff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931306:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6d22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931312:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6d22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931318:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6d22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931323:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583122.931326:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6d22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931332:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6d22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931340:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583122.931342:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583122.931345:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6d22 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931351:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b6d22 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931360:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931377:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931390:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931394:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480a00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583122.931397:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931403:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931411:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583122.931414:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583122.931416:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d68 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931421:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480a00/0x19a47956376b6d68 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931433:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931439:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931445:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931450:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344deda00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583122.931452:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931467:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931475:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:2.0:1787583122.931477:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787583122.931480:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e6b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.931486:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b6e6b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787583122.931562:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787583122.931614:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787583122.931629:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435869568 00000100:00100000:2.0:1787583122.931635:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435869568 00000100:00100000:2.0:1787583122.931677:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787583122.931686:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435869568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787583122.931785:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787583122.931789:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787583121 00002000:00010000:2.0:1787583122.931791:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787583122.931793:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787583121 -> 1787583121 00002000:00010000:2.0:1787583122.931796:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787583122.931840:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1874416435869568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (923us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787583122.931877:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787583122.931897:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583122.931907:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435869696:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787583122.931936:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583122.931969:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435869696 00000100:00100000:2.0:1787583122.931973:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435869696 00000100:00100000:2.0:1787583122.931996:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787583122.932003:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1874416435869696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787583122.932017:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1787583122.932042:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c5a8f, atime: 0x6a8c5a8f, ctime: 0x6a8c5a8f, blocks: 0x8 00010000:00010000:2.0:1787583122.932049:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055bd0228/0x19a47956376b6e95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.932063:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=430s v=(0 0) 00010000:00010000:2.0:1787583122.932067:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583122.932074:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055bd0228/0x19a47956376b6e95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.932088:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055bd0228/0x19a47956376b6e95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.932096:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055bd0228/0x19a47956376b6e95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.932104:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055bd0228/0x19a47956376b6e95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.932120:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787583122.932250:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3654:x1874416435869696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 246us (312us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787583122.932257:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1787583122.932300:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583122.932305:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055bd0228/0x19a47956376b6e95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.932312:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770ba00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583122.932316:0:7469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055bd0228/0x19a47956376b6e95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.932325:0:7469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055bd0228/0x19a47956376b6e95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.932338:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055bd0228/0x19a47956376b6e95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.932346:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055bd0228/0x19a47956376b6e95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.932359:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583122.932361:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583122.932362:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787583122.932403:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff909247f8ce00/2, rc 0, transno 4294967308 00000100:00100000:2.0:1787583122.932410:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435869696:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1787583122.932435:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90924846bb80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1787583122.932439:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435869568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787583122.932539:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:12376:x1874416413792512:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 3495us (3832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583122.932548:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 198 00000100:00100000:1.0:1787583122.935022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.935093:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413792640 00000100:00100000:2.0:1787583122.935103:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413792640 00000100:00100000:2.0:1787583122.935185:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1787583122.935195:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:2405:x1874416413792640:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787583122.936484:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1787583122.936494:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1787583122.936629:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2405:x1874416413792640:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 1432us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583122.936638:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:3.0:1787583122.938762:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.938799:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413792896 00000100:00100000:3.0:1787583122.938807:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413792896 00000100:00100000:3.0:1787583122.938885:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 199 00000100:00100000:3.0:1787583122.938896:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:12376:x1874416413792896:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787583122.938948:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583122.938974:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dede00/0x19a47956376b6e80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4440 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.939005:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:3.0:1787583122.939009:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787583122.939040:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.939053:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.939062:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787583122.939179:0:6529:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5f46d25 reply state 00000000caa95876 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.939191:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.939197:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:3.0:1787583122.939200:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787583122.939203:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787583122.939295:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:12376:x1874416413792896:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 400us (538us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1787583122.939302:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 199 00000100:00100000:3.0:1787583122.941381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.941695:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413793024 00000100:00100000:2.0:1787583122.941704:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413793024 00000100:00100000:2.0:1787583122.941782:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:2.0:1787583122.941822:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413793024:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787583122.941975:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787583122.941979:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787583121 -> 1787583121 00002000:00010000:2.0:1787583122.941981:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787583119 00002000:00010000:2.0:1787583122.941983:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787583121 -> 1787583121 00002000:00010000:2.0:1787583122.941985:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787583122.942031:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2407:x1874416413793024:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 212us (670us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787583122.942464:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1787583122.954118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.954215:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413793280 00000100:00100000:2.0:1787583122.954225:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413793280 00000100:00100000:2.0:1787583122.954388:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:2.0:1787583122.954399:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909248468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:12376:x1874416413793280:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787583122.954470:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.954499:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4432 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.954509:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.954544:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4432 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.954558:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4432 expref: 20 pid: 6529 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583122.954574:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874416435869824:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583122.954899:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246773240 going to sleep for 11 seconds 00000100:00100000:2.0:1787583122.957887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583122.957959:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413793408 00000100:00100000:1.0:1787583122.957967:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413793408 00010000:00010000:1.0:1787583122.958004:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e64 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4432 expref: 21 pid: 6529 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583122.958044:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:1.0:1787583122.958055:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:2406:x1874416413793408:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583122.958067:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583122.958074:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e64 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4432 expref: 21 pid: 6529 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.958086:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4432 expref: 21 pid: 6529 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.958106:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:1.0:1787583122.958110:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.958133:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.958140:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.958156:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583122.958201:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:2406:x1874416413793408:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 148us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583122.958209:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00010000:00010000:3.0:1787583122.959176:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6e64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4432 expref: 20 pid: 6529 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583122.959195:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874416435869824:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583122.959228:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.959237:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.959243:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.959292:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.959300:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.959307:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.959313:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770ba00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583122.959317:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.959324:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.959335:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:3.0:1787583122.959337:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787583122.959341:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.959346:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ea3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583122.959433:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909248468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:12376:x1874416413793280:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 5035us (5323us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787583122.959442:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:2.0:1787583122.967018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.967173:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413793536 00000100:00100000:3.0:1787583122.967184:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413793536 00000100:00100000:3.0:1787583122.967240:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:3.0:1787583122.967250:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2404:x1874416413793536:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787583122.967301:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.967322:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c444e expref: 8 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.967331:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583122.967335:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787583122.967340:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.967386:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c444e expref: 8 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.967401:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c444e expref: 8 pid: 8444 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583122.967416:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8445:1874416435869952:192.168.203.11@tcp:104: 00000100:00100000:3.0:1787583122.967513:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787583122.974603:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8445:1874416435869952:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583122.974635:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583122.975564:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.975815:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413793664 00000100:00100000:3.0:1787583122.975823:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413793664 00010000:00010000:3.0:1787583122.975888:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c444e expref: 9 pid: 8444 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583122.975920:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:3.0:1787583122.975929:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2406:x1874416413793664:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583122.975942:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583122.975961:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c444e expref: 9 pid: 8444 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.975974:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c444e expref: 9 pid: 8444 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.975994:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a1b56d2/0x19a47956376b6e8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c444e expref: 9 pid: 8444 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.976010:0:6514:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787583122.976015:0:6514:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787583122.976020:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.976040:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.976062:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583122.976104:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2406:x1874416413793664:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 176us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583122.976111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 91 00010000:00010000:3.0:1787583122.976133:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.976142:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.976160:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.976168:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.976177:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.976183:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e200 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583122.976188:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.976207:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.976219:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.976227:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008414f67/0x19a47956376b6eaa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583122.976278:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2404:x1874416413793536:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 9030us (9271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583122.976285:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1787583122.979546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583122.979640:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413793920 00000100:00100000:3.0:1787583122.979650:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413793920 00000100:00100000:3.0:1787583122.979721:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 201 00000100:00100000:3.0:1787583122.979731:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:12376:x1874416413793920:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787583122.979808:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.979825:0:13828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6cf8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d7 expref: 19 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.979835:0:13828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.979899:0:13828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d7 expref: 19 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583122.979926:0:13828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d7 expref: 19 pid: 7748 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583122.979941:0:13828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eba300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435870080:192.168.203.11@tcp:104: 00000100:00100000:3.0:1787583122.980012:0:13828:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787583122.986228:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583122.986317:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413794048 00000100:00100000:0.0:1787583122.986327:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413794048 00010000:00010000:0.0:1787583122.986387:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6cf8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d7 expref: 20 pid: 7748 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583122.986399:0:13828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eba300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435870080:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583122.986421:0:13828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583122.986428:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:0.0:1787583122.986438:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:2406:x1874416413794048:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583122.986450:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583122.986461:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d7 expref: 20 pid: 7748 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.986474:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d7 expref: 20 pid: 7748 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.986494:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b6cf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c43d7 expref: 20 pid: 7748 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.986508:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:0.0:1787583122.986513:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.986541:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.986548:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.986581:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583122.986637:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:2406:x1874416413794048:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 200us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583122.986644:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 92 00010000:00010000:2.0:1787583122.986879:0:13828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.986887:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.987101:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.987113:0:13828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909340031a00/0x19a47956376b6e72 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4439 expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.987121:0:13828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.987151:0:13828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909340031a00/0x19a47956376b6e72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4439 expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.987164:0:13828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909340031a00/0x19a47956376b6e72 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4439 expref: 19 pid: 6529 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583122.987178:0:13828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435870208:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583122.987247:0:13828:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246773a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787583122.990109:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.990288:0:13828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435870208:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583122.990312:0:13828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583122.990947:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413794176 00000100:00100000:0.0:1787583122.990955:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413794176 00010000:00010000:0.0:1787583122.990992:0:13742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909340031a00/0x19a47956376b6e72 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4439 expref: 20 pid: 6529 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583122.991062:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:0.0:1787583122.991072:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:2407:x1874416413794176:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583122.991086:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583122.991093:0:13742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909340031a00/0x19a47956376b6e72 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4439 expref: 20 pid: 6529 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.991105:0:13742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909340031a00/0x19a47956376b6e72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4439 expref: 20 pid: 6529 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.991126:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909340031a00/0x19a47956376b6e72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4439 expref: 20 pid: 6529 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.991163:0:13742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:0.0:1787583122.991167:0:13742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.991177:0:13742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.991184:0:13742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583122.991209:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583122.991266:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:2407:x1874416413794176:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 195us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583122.991273:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 93 00010000:00010000:2.0:1787583122.991383:0:13828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.991390:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787583122.991495:0:13828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1787583122.991617:0:13828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1787583122.991666:0:13828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1787583122.991735:0:13828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13828:1874416435870336:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787583122.991781:0:13828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583122.991815:0:13828:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246773000 going to sleep for 11 seconds 00000100:00100000:1.0:1787583122.991877:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435870336 00000100:00100000:1.0:1787583122.991882:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435870336 00000100:00100000:1.0:1787583122.991918:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787583122.991926:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13828:x1874416435870336:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787583122.992003:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13828:x1874416435870336:12345-0@lo:1000:mdt00_004.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583122.992009:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787583122.992040:0:13828:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1787583122.992046:0:13828:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90924846bb80, transno 4294967316 00000100:00100000:1.0:1787583122.992057:0:13828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13828:1874416435870336:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1787583122.992183:0:13828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1787583122.992223:0:13828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909248469180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13828:1874416435870464:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787583122.992251:0:13828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583122.992273:0:13828:0:(client.c:2715:ptlrpc_set_wait()) set ffff90934562b840 going to sleep for 11 seconds 00000100:00100000:2.0:1787583122.992430:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435870464 00000100:00100000:2.0:1787583122.992435:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435870464 00000100:00100000:2.0:1787583122.992461:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787583122.992468:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909248468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:13828:x1874416435870464:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787583122.992566:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909248468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:13828:x1874416435870464:12345-0@lo:1000:mdt00_004.0 Request processed in 98us (314us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787583122.992573:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787583122.992892:0:13828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909248469180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13828:1874416435870464:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787583122.992926:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.992945:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.992951:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.992956:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583122.992961:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.992968:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.992982:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:1.0:1787583122.992985:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787583122.992989:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.992994:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6eb8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.993017:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6ded lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.993024:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6ded lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.993029:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6ded lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.993034:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583122.993043:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6ded lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.993050:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6ded lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.993059:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:1.0:1787583122.993062:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787583122.993064:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6ded lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.993069:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480200/0x19a47956376b6ded lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.993092:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.993105:0:13828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c441d expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.993114:0:13828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.993137:0:13828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c441d expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.993150:0:13828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c441d expref: 22 pid: 6527 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583122.993161:0:13828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435870592:192.168.203.11@tcp:104: 00000100:00100000:1.0:1787583122.993222:0:13828:0:(client.c:2715:ptlrpc_set_wait()) set ffff90934562b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787583122.996304:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583122.996442:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413794304 00000100:00100000:2.0:1787583122.996451:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413794304 00010000:00010000:2.0:1787583122.996487:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c441d expref: 23 pid: 6527 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583122.996527:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:2.0:1787583122.996536:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:2406:x1874416413794304:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583122.996550:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583122.996556:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c441d expref: 23 pid: 6527 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.996569:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c441d expref: 23 pid: 6527 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.996592:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:2.0:1787583122.996597:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.996619:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.996627:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583122.996643:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583122.996689:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:2406:x1874416413794304:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 154us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583122.996696:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 94 00010000:00010000:1.0:1787583122.998685:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6e09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c441d expref: 22 pid: 6527 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583122.998707:0:13828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435870592:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583122.998730:0:13828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998740:0:13828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998747:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998760:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998766:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998773:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998779:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583122.998783:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998790:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998804:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:1.0:1787583122.998807:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583122.998826:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998832:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b6ebf lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998841:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998871:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998876:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998881:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583122.998883:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998889:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998897:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053600) 00010000:00010000:1.0:1787583122.998900:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787583122.998902:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583122.998908:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6eb1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583122.999078:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:12376:x1874416413793920:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 19346us (19541us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787583122.999087:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 201 00000020:00080000:1.0:1787583122.999100:0:13828:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787583123.001092:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787583123.001100:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787583123.001189:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787583123.001197:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787583123.007084:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583123.007246:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413794560 00000100:00100000:2.0:1787583123.007267:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413794560 00000100:00100000:2.0:1787583123.007318:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1787583123.007328:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373fa5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:12376:x1874416413794560:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787583123.007637:0:6530:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787583123.007673:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1787583123.007707:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6ec6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.007724:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.007735:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.007744:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6ec6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.007750:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6ec6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.007772:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.007797:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787583123.007825:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583123.007831:0:10405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6ec6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.007838:0:10405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a600 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583123.007841:0:10405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6ec6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583123.007899:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373fa5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:12376:x1874416413794560:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 571us (824us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787583123.007908:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000020:00080000:2.0:1787583123.007913:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787583123.009524:0:10405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.009543:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:3.0:1787583123.009546:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787583123.009551:0:10405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6ec6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.009732:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6ec6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.009841:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583123.010151:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583123.010154:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787583123.279732:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787583123.407500:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787583123.408817:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583123.408841:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435871104:0@lo:400:kworker.0 00000100:00100000:2.0:1787583123.409110:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583123.409172:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435870976:0@lo:400:kworker.0 00000100:00100000:2.0:1787583123.409199:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583123.409220:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787583123.409226:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435870848:0@lo:400:kworker.0 00000100:00100000:2.0:1787583123.409249:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583123.410225:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435870720:0@lo:400:kworker.0 00000100:00100000:1.0:1787583123.410269:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583123.410298:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787583123.410305:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fdbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435871232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583123.410332:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583123.410373:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435870720 00000100:00100000:1.0:1787583123.410381:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435870720 00000100:00100000:1.0:1787583123.410436:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787583123.410446:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435870720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583123.410499:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435870720:12345-0@lo:400:kworker.0 Request processed in 55us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583123.410508:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787583123.410540:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435870976 00000100:00100000:1.0:1787583123.410544:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435870976 00000100:00100000:1.0:1787583123.410570:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435871232 00000100:00100000:1.0:1787583123.410573:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435871232 00000100:00100000:1.0:1787583123.410588:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787583123.410594:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435870976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583123.410634:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435870976:12345-0@lo:400:kworker.0 Request processed in 41us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583123.410641:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787583123.410666:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787583123.410673:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435871232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787583123.410696:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787583123.410749:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435871232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583123.410775:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787583123.410823:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fdbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435871232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583123.410833:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435870720:0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.412947:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435871360:0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.413009:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583123.413062:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435871104 00000100:00100000:0.0:1787583123.413068:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435871104 00000100:00100000:0.0:1787583123.413107:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435870848 00000100:00100000:0.0:1787583123.413110:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435870848 00000100:00100000:0.0:1787583123.413127:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787583123.413136:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435871104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.413186:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874416435871104:12345-0@lo:400:kworker.0 Request processed in 51us (4075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583123.413193:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787583123.413217:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435871360 00000100:00100000:0.0:1787583123.413220:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435871360 00000100:00100000:0.0:1787583123.413245:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787583123.413252:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435870848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.413284:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435870848:12345-0@lo:400:kworker.0 Request processed in 33us (4034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583123.413290:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787583123.413303:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787583123.413309:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435871360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.413338:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874416435871360:12345-0@lo:400:kworker.0 Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583123.413343:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787583123.413391:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874416435871360:0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.413428:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787583123.413434:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90924846ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435871488:0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.413459:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583123.413483:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435871488 00000100:00100000:0.0:1787583123.413486:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435871488 00000100:00100000:0.0:1787583123.413511:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787583123.413518:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092476ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435871488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583123.413526:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874416435871104:0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.413555:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092476ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435871488:12345-0@lo:400:kworker.0 Request processed in 38us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583123.413564:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787583123.413659:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787583123.413667:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435871616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583123.413767:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583123.413799:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435871616 00000100:00100000:3.0:1787583123.413803:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435871616 00000100:00100000:3.0:1787583123.413834:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787583123.413842:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874416435871616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787583123.413958:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787583123.413999:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874416435871616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583123.414006:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787583123.414042:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435871616:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787583123.414145:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787583123.414149:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787583123.414151:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787583123.414178:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435870848:0@lo:400:kworker.0 00000100:00100000:3.0:1787583123.414194:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435870976:0@lo:400:kworker.0 00010000:00080000:0.0:1787583123.415892:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90924846ea00 x1874416435871488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583123.415910:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90924846ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435871488:0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.415999:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583123.416011:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435871744:0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.416061:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583123.416137:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092484f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435871872:0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.416165:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583123.416204:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787583123.416210:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092484f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435872000:0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.416233:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583123.416271:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092484f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435872128:0@lo:400:kworker.0 00000100:00100000:3.0:1787583123.416288:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435871744 00000100:00100000:3.0:1787583123.416296:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435871744 00000100:00100000:0.0:1787583123.416298:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583123.416346:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435872128 00000100:00100000:3.0:1787583123.416350:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435872128 00000100:00100000:3.0:1787583123.416416:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787583123.416426:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435871744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583123.416444:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787583123.416456:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435872128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583123.416501:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435872128:12345-0@lo:400:kworker.0 Request processed in 48us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583123.416509:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787583123.416534:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435871744:12345-0@lo:400:kworker.0 Request processed in 108us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583123.416542:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787583123.416566:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092484f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435872128:0@lo:400:kworker.0 00000100:00100000:2.0:1787583123.416590:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435871744:0@lo:400:kworker.0 00000100:00080000:0.0:1787583123.416907:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787583123.418240:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435871872 00000100:00100000:2.0:1787583123.418250:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435871872 00000100:00100000:2.0:1787583123.418313:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435872000 00000100:00100000:2.0:1787583123.418316:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435872000 00000100:00100000:2.0:1787583123.418339:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787583123.418348:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435871872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583123.418425:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435871872:12345-0@lo:400:kworker.0 Request processed in 77us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583123.418431:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787583123.418630:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787583123.418641:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435872000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583123.418679:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435872000:12345-0@lo:400:kworker.0 Request processed in 42us (2445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583123.418691:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:3.0:1787583123.418712:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787583123.418716:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787583123.419430:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092484f6a00 x1874416435872000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583123.419446:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092484f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435872000:0@lo:400:kworker.0 00000100:00100000:0.0:1787583123.419459:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092484f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435871872:0@lo:400:kworker.0 00000040:00080000:3.0:1787583123.561962:0:14667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787583123.561970:0:14667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787583123.561993:0:14667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787583123.562000:0:14667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787583123.690765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583123.691007:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413794816 00000100:00100000:1.0:1787583123.691098:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413794816 00000100:00100000:1.0:1787583123.692560:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:1.0:1787583123.692575:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:12393:x1874416413794816:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1787583123.692599:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583123.692618:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6ecd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4455 expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.692731:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ed4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.692745:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ed4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.692767:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ed4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583123.692779:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787583123.692903:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6ecd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4455 expref: 26 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.692919:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4455 expref: 25 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.692938:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:1.0:1787583123.692941:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787583123.692946:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53000, rc 0) 00000100:00100000:1.0:1787583123.693010:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+25:12393:x1874416413794816:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 438us (2263us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787583123.693028:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:1.0:1787583123.704696:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583123.705389:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413794944 00000100:00100000:2.0:1787583123.705399:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413794944 00000100:00100000:2.0:1787583123.705474:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:2.0:1787583123.705484:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+25:12393:x1874416413794944:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:2.0:1787583123.705566:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6ee2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705593:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705604:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705620:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6ee9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705626:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705632:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705732:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705741:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705758:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787583123.705805:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705817:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705824:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6ee2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705830:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705836:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583123.705840:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705869:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6ee2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705882:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583123.705886:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583123.705890:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6ee2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705904:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6ee2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705916:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705922:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705928:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705932:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770bc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583123.705935:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705940:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705947:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff909343053300) 00010000:00010000:2.0:1787583123.705950:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583123.705952:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6ee9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705958:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6ee9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705972:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705977:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705988:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.705992:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770ba00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583123.705996:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.706001:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.706008:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053d00) 00010000:00010000:2.0:1787583123.706024:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583123.706027:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.706032:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583123.706232:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+25:12393:x1874416413794944:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 748us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583123.706241:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:0.0:1787583123.787741:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583123.787825:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413795200 00000100:00100000:2.0:1787583123.787833:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413795200 00000100:00100000:2.0:1787583123.787934:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:2.0:1787583123.787944:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+25:12396:x1874416413795200:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583123.787964:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583123.787982:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c445c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788072:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6efe lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788086:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6efe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788096:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6efe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788109:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788117:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788123:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788220:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788229:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788236:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583123.788245:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787583123.788318:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6efe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788326:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6efe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788338:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6efe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788345:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770bc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583123.788349:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6efe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788357:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6efe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788381:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583123.788384:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583123.788388:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6efe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788394:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770bc00/0x19a47956376b6efe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788404:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788409:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788414:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788419:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583123.788422:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788442:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788451:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff909343053d00) 00010000:00010000:2.0:1787583123.788453:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583123.788456:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788461:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788501:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6ef7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c445c expref: 28 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788514:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c445c expref: 27 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.788521:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:2.0:1787583123.788524:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583123.788526:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a600, rc 0) 00000100:00100000:2.0:1787583123.788599:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:12396:x1874416413795200:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 656us (867us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787583123.788607:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:2.0:1787583123.793770:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583123.794020:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413795328 00000100:00100000:3.0:1787583123.794030:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413795328 00000100:00100000:3.0:1787583123.794092:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 205 00000100:00100000:3.0:1787583123.794103:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fdbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:12396:x1874416413795328:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1787583123.794178:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.794195:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.794207:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.794261:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.794269:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.794276:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.794282:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583123.794286:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.794293:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.794305:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:3.0:1787583123.794309:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787583123.794313:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f1a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.794320:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583123.794410:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fdbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:12396:x1874416413795328:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 308us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583123.794418:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 205 00000100:00100000:2.0:1787583123.797470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583123.797552:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413795584 00000100:00100000:3.0:1787583123.797561:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413795584 00000100:00100000:3.0:1787583123.797622:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:3.0:1787583123.797646:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:12396:x1874416413795584:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1787583123.797887:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+28:12396:x1874416413795584:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 241us (428us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787583123.797895:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:0.0:1787583123.851122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583123.851217:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413795840 00000100:00100000:1.0:1787583123.851227:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413795840 00000100:00100000:1.0:1787583123.851286:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:1.0:1787583123.851296:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+28:11929:x1874416413795840:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1787583123.851321:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583123.851340:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6f21 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4463 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.851461:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.851475:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c445c expref: 29 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.851483:0:7748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.851516:0:7748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c445c expref: 29 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.851550:0:7748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c445c expref: 29 pid: 6527 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583123.851565:0:7748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909248469880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435872256:192.168.203.11@tcp:104: 00000100:00100000:1.0:1787583123.851665:0:7748:0:(client.c:2715:ptlrpc_set_wait()) set ffff90934562b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583123.854176:0:7748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909248469880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435872256:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583123.854205:0:7748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583123.854593:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583123.854691:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583123.854815:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413795968 00000100:00100000:1.0:1787583123.854823:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413795968 00010000:00010000:1.0:1787583123.854899:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c445c expref: 30 pid: 6527 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583123.854937:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:1.0:1787583123.854948:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+30:2407:x1874416413795968:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583123.854962:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583123.854969:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c445c expref: 30 pid: 6527 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.854983:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c445c expref: 30 pid: 6527 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.855006:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c445c expref: 30 pid: 6527 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.855034:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:1.0:1787583123.855040:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.855049:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.855056:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.855144:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583123.855200:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:2407:x1874416413795968:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 253us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583123.855214:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 95 00010000:00010000:1.0:1787583123.855392:0:7748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.855400:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583123.855418:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787583123.855547:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6f21 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4463 expref: 30 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.855561:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4463 expref: 29 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.855568:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:1.0:1787583123.855571:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787583123.855573:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52200, rc 0) 00000100:00100000:1.0:1787583123.855613:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:11929:x1874416413795840:12345-192.168.203.11@tcp:101:bash.0 Request processed in 4319us (4501us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1787583123.855630:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:2.0:1787583123.860274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583123.860344:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413796096 00000100:00100000:1.0:1787583123.860355:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413796096 00000100:00100000:1.0:1787583123.860424:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 207 00000100:00100000:1.0:1787583123.860435:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:11929:x1874416413796096:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1787583123.860459:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583123.860478:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6f36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c446a expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.860513:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6f3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.860526:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6f3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.860537:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6f3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.860667:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6f36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c446a expref: 31 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.860895:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6f3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c446a expref: 30 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.860905:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:1.0:1787583123.860908:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787583123.860912:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52c00, rc 0) 00000100:00100000:1.0:1787583123.860965:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+30:11929:x1874416413796096:12345-192.168.203.11@tcp:101:bash.0 Request processed in 532us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583123.860980:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 207 00000100:00100000:2.0:1787583123.863538:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583123.863899:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413796352 00000100:00100000:3.0:1787583123.863909:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413796352 00000100:00100000:3.0:1787583123.863968:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 208 00000100:00100000:3.0:1787583123.863980:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+30:11929:x1874416413796352:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:3.0:1787583123.864203:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.864221:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.864231:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787583123.864275:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1787583123.864298:0:6529:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a10597dc reply state 00000000ca5d3c31 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.864310:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583123.864318:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:3.0:1787583123.864321:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787583123.864324:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787583123.864375:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1787583123.864471:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+34:11929:x1874416413796352:12345-192.168.203.11@tcp:36:bash.0 Request processed in 492us (942us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787583123.864497:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 208 00000020:00080000:3.0:1787583123.864501:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787583123.868936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583123.869121:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413796480 00000100:00100000:1.0:1787583123.869131:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413796480 00000100:00100000:1.0:1787583123.869191:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 209 00000100:00100000:1.0:1787583123.869202:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+34:11929:x1874416413796480:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1787583123.869224:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583123.869244:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6f4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4471 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.869303:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6f4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4471 expref: 35 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.869317:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6f4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4471 expref: 35 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.869335:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:1.0:1787583123.869339:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787583123.869343:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53400, rc 0) 00000100:00100000:1.0:1787583123.869417:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+35:11929:x1874416413796480:12345-192.168.203.11@tcp:101:bash.0 Request processed in 218us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583123.869424:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 209 00000100:00100000:0.0:1787583123.872830:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583123.873048:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413796608 00000100:00100000:2.0:1787583123.873057:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413796608 00000100:00100000:2.0:1787583123.873125:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1787583123.873137:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:11929:x1874416413796608:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1787583123.873154:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583123.873175:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6f52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4478 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787583123.873198:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c5a91, atime: 0x6a8c5a8f, ctime: 0x6a8c5a91, blocks: 0x8 00010000:00010000:2.0:1787583123.873217:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787583123.873222:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583123.873230:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6f52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4478 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.873245:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6f52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4478 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583123.873258:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770bc00, rc 0) 00000100:00100000:2.0:1787583123.873314:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:11929:x1874416413796608:12345-192.168.203.11@tcp:101:bash.0 Request processed in 179us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583123.873321:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00080000:3.0:1787583123.873549:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583123.876382:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583123.876463:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413796736 00000100:00100000:3.0:1787583123.876473:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413796736 00002000:00010000:3.0:1787583123.876516:0:8450:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1787583123.876522:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9092484f4000 with x1874416413796736 ext(0->18446744073709551615) 00002000:00010000:3.0:1787583123.876534:0:8450:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9092484f4000. 00000100:00100000:3.0:1787583123.876565:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:3.0:1787583123.876585:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2407:x1874416413796736:12345-192.168.203.11@tcp:10:bash.0 00002000:00010000:3.0:1787583123.877167:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787583123.877172:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787583121 -> 1787583122 00002000:00010000:3.0:1787583123.877175:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787583119 -> 1787583119 00002000:00010000:3.0:1787583123.877177:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787583121 -> 1787583122 00002000:00010000:3.0:1787583123.877179:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1787583123.877327:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413796736:12345-192.168.203.11@tcp:10:bash.0 Request processed in 749us (950us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787583123.877335:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00002000:00010000:3.0:1787583123.877339:0:8450:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1787583123.877341:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9092484f4000 with x1874416413796736 ext(0->18446744073709551615) 00002000:00010000:3.0:1787583123.877346:0:8450:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9092484f4000. 00000100:00100000:2.0:1787583123.918470:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787583123.918521:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435872384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583123.918612:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583123.919087:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435872384 00000100:00100000:1.0:1787583123.919096:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435872384 00000100:00100000:1.0:1787583123.919153:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787583123.919164:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435872384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787583123.919186:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787583123.919246:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435872384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583123.919254:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787583123.919496:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435872384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583123.991036:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583123.991352:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413796864 00000100:00100000:1.0:1787583123.991373:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413796864 00000100:00100000:1.0:1787583123.991448:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:1.0:1787583123.991459:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+35:12410:x1874416413796864:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:1.0:1787583123.991535:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6f59 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.991552:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6f59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.991563:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6f59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.991579:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6f60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.991586:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.991592:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.991665:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6f67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.991675:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6f67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.991782:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6f67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583123.991990:0:13828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6f67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992004:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6f59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992011:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6f59 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992018:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6f59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992024:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583123.992028:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6f59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992035:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6f59 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992046:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:1.0:1787583123.992049:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583123.992052:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6f59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992058:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53200/0x19a47956376b6f59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992071:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992077:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6f60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992089:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6f60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992094:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52a00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583123.992097:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6f60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992103:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6f60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992110:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff909342920e00) 00010000:00010000:1.0:1787583123.992112:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583123.992114:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6f60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992119:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52a00/0x19a47956376b6f60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992131:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6f67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992137:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6f67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992143:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6f67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992147:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583123.992150:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6f67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992163:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6f67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992170:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:1.0:1787583123.992172:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583123.992175:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6f67 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583123.992181:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b6f67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583123.992290:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+35:12410:x1874416413796864:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 832us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583123.992298:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:0.0:1787583124.069326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.069495:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413797120 00000100:00100000:2.0:1787583124.069506:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413797120 00000100:00080000:3.0:1787583124.069588:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583124.069628:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:2.0:1787583124.069640:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+35:12413:x1874416413797120:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583124.069660:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583124.069681:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6f6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c447f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.069751:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f75 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.069770:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.069781:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.069798:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.069805:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.069811:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070041:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6f83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070051:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6f83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070059:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6f83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583124.070069:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787583124.070146:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070153:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f75 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070160:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070166:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583124.070170:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070178:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f75 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070190:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583124.070193:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583124.070198:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070215:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6f75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070230:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070235:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070241:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070246:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583124.070249:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070255:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070262:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff909343053a00) 00010000:00010000:2.0:1787583124.070265:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583124.070268:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f7c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070273:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6f7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070314:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6f6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c447f expref: 38 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070328:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6f83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c447f expref: 37 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.070341:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:2.0:1787583124.070343:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787583124.070346:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770ba00, rc 0) 00000100:00100000:2.0:1787583124.070412:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+37:12413:x1874416413797120:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 775us (1096us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787583124.070420:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:0.0:1787583124.074214:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.074304:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413797248 00000100:00100000:3.0:1787583124.074313:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413797248 00000100:00100000:3.0:1787583124.074381:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:3.0:1787583124.074391:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+37:12413:x1874416413797248:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1787583124.074475:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.074491:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4463 expref: 37 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.074500:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.074542:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4463 expref: 37 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.074555:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4463 expref: 37 pid: 7748 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583124.074570:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435872512:192.168.203.11@tcp:104: 00000100:00100000:3.0:1787583124.074659:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91180 going to sleep for 11 seconds 00000100:00100000:0.0:1787583124.083182:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.083415:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413797504 00000100:00100000:2.0:1787583124.083425:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413797504 00000100:00100000:2.0:1787583124.083488:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:2.0:1787583124.083501:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:6175:x1874416413797504:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787583124.083789:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+39:6175:x1874416413797504:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 290us (615us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787583124.083798:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:3.0:1787583124.088191:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435872512:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583124.088219:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583124.088458:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.088541:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413797632 00000100:00100000:2.0:1787583124.088549:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413797632 00010000:00010000:2.0:1787583124.088587:0:13742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4463 expref: 39 pid: 7748 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583124.088627:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:2.0:1787583124.088637:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093770b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+39:2407:x1874416413797632:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583124.088750:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583124.088759:0:13742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4463 expref: 39 pid: 7748 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.088773:0:13742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4463 expref: 39 pid: 7748 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.088812:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52200/0x19a47956376b6f28 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4463 expref: 39 pid: 7748 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.088827:0:13742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:2.0:1787583124.088832:0:13742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.088842:0:13742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.088887:0:13742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.088915:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583124.088966:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093770b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:2407:x1874416413797632:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 330us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583124.088974:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 96 00010000:00010000:3.0:1787583124.089414:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.089423:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.089463:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.089481:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.089488:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.089493:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583124.089497:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.089503:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.089514:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:3.0:1787583124.089517:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787583124.089520:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.089526:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583124.089624:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+37:12413:x1874416413797248:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 15233us (15418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583124.089632:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:0.0:1787583124.098744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.101659:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413797888 00000100:00100000:2.0:1787583124.101675:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413797888 00000100:00100000:2.0:1787583124.101746:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:2.0:1787583124.101757:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+37:12413:x1874416413797888:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1787583124.102308:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:12413:x1874416413797888:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 550us (3573us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787583124.102317:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:1.0:1787583124.179338:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.179451:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413798144 00000100:00100000:3.0:1787583124.179462:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413798144 00000100:00100000:3.0:1787583124.179525:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:3.0:1787583124.179537:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909248469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+38:12424:x1874416413798144:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:3.0:1787583124.179562:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583124.179607:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4486 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.179697:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6f9f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.179711:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6f9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.179721:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6f9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.179736:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6fa6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.179742:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.179749:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.179927:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497200/0x19a47956376b6fad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.179938:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248497200/0x19a47956376b6fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.179945:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497200/0x19a47956376b6fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583124.179954:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787583124.180028:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6f9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180044:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6f9f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180050:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6f9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180055:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583124.180059:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6f9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180067:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6f9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180078:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:3.0:1787583124.180080:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583124.180084:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6f9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180089:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b6f9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180102:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180107:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180112:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180116:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583124.180125:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180130:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180138:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90937e3bec00) 00010000:00010000:3.0:1787583124.180140:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583124.180143:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6fa6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180148:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b6fa6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180190:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b6f98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4486 expref: 41 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180204:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497200/0x19a47956376b6fad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4486 expref: 40 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.180210:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:3.0:1787583124.180213:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787583124.180215:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248497200, rc 0) 00000100:00100000:3.0:1787583124.180270:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909248469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+40:12424:x1874416413798144:12345-192.168.203.11@tcp:101:cat.0 Request processed in 736us (942us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787583124.180277:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:2.0:1787583124.187379:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.187464:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413798400 00000100:00100000:3.0:1787583124.187474:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413798400 00000100:00100000:3.0:1787583124.187532:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:3.0:1787583124.187543:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+40:12424:x1874416413798400:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:3.0:1787583124.187892:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+41:12424:x1874416413798400:12345-192.168.203.11@tcp:35:cat.0 Request processed in 349us (533us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787583124.187900:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:0.0:1787583124.208570:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.208690:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413798656 00000100:00100000:2.0:1787583124.208700:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413798656 00000100:00100000:2.0:1787583124.208823:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 214 00000100:00100000:2.0:1787583124.208833:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+41:12425:x1874416413798656:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1787583124.209146:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787583124.209173:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53400/0x19a47956376b6f4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4471 expref: 41 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209191:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497200/0x19a47956376b6fad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4486 expref: 40 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209204:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b6f83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c447f expref: 39 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209216:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52c00/0x19a47956376b6f3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c446a expref: 38 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209225:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:2.0:1787583124.209230:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583124.209252:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6fbb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209263:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6fbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209272:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6fbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209285:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6fc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209291:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209305:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209394:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6fc9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209402:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6fc9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209409:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6fc9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787583124.209614:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787583124.209623:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 431362776626ns, next at 432362774239ns, rc = 0 00010000:00010000:2.0:1787583124.209665:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6fd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209673:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209829:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209836:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6fd0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.209842:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6fd0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210020:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210087:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787583124.210108:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6fc9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210114:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6fc9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210120:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6fc9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210125:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583124.210130:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6fc9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210137:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6fc9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210146:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:2.0:1787583124.210148:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787583124.210152:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6fc9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210157:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b6fc9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210173:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6fbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210178:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6fbb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210183:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6fbb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210193:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583124.210197:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6fbb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210202:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6fbb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210210:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583124.210212:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583124.210215:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6fbb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210220:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b6fbb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787583124.210229:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd788de8 reply state 0000000074566a0c transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210239:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6fc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.210244:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff909343053a00) 00010000:00010000:2.0:1787583124.210246:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787583124.210248:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787583124.210331:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+39:12425:x1874416413798656:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1497us (1768us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787583124.210339:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 214 00010000:00010000:0.0:1787583124.215279:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583124.215293:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6fd0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.215303:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770ae00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583124.215308:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6fd0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.215317:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.215336:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:0.0:1787583124.215339:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787583124.215343:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6fd0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.215349:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b6fd0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.215380:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583124.215382:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583124.215384:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583124.256463:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.256545:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413798912 00000100:00100000:3.0:1787583124.256553:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413798912 00000100:00100000:3.0:1787583124.256611:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:3.0:1787583124.256623:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+39:12431:x1874416413798912:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1787583124.256646:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583124.256666:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b6fd7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c448d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.256764:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b6fde lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.256777:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b6fde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.256787:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b6fde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.256796:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496400/0x19a47956376b6fe5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.256802:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496400/0x19a47956376b6fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.256807:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496400/0x19a47956376b6fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787583124.257285:0:6528:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787583124.257426:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b6fec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257434:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b6fec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257440:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b6fec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257466:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b6fde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257472:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b6fde lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257479:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b6fde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257483:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248496a00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583124.257487:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b6fde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257492:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b6fde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257502:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:3.0:1787583124.257504:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583124.257507:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b6fde lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257512:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b6fde lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787583124.257532:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c97f55ab reply state 00000000cba44c7c transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff909248496400/0x19a47956376b6fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257542:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496400/0x19a47956376b6fe5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257548:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff909343053a00) 00010000:00010000:3.0:1787583124.257549:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787583124.257552:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787583124.257577:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b6fd7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c448d expref: 42 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257592:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b6fec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c448d expref: 41 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.257598:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e3bec00) 00010000:00010000:3.0:1787583124.257600:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787583124.257602:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248496000, rc 0) 00000100:00100000:3.0:1787583124.257665:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+42:12431:x1874416413798912:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1044us (1209us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787583124.257673:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:3.0:1787583124.262194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.263135:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413799040 00000100:00100000:2.0:1787583124.263148:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413799040 00000100:00100000:2.0:1787583124.263232:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:2.0:1787583124.263257:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2404:x1874416413799040:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1787583124.263274:0:8752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583124.263293:0:8752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f8f9256/0x19a47956376b6ffa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4494 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787583124.263320:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787583124.263340:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787583124.263344:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583124.263355:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f8f9256/0x19a47956376b6ffa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4494 expref: 8 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.263385:0:8752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f8f9256/0x19a47956376b6ffa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4494 expref: 8 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.263398:0:8752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770b600, rc 0) 00000100:00080000:3.0:1787583124.263523:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787583124.263628:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2404:x1874416413799040:12345-192.168.203.11@tcp:101:bash.0 Request processed in 373us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583124.263636:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1787583124.271088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.271179:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413799168 00000100:00100000:2.0:1787583124.271189:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413799168 00000100:00100000:2.0:1787583124.271248:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:2.0:1787583124.271259:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:12431:x1874416413799168:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1787583124.271276:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583124.271293:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c449b expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.271351:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f8f9256/0x19a47956376b6ffa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4494 expref: 9 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.271370:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583124.271375:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583124.271380:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 9 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.271417:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f8f9256/0x19a47956376b6ffa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4494 expref: 9 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.271432:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f8f9256/0x19a47956376b6ffa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4494 expref: 9 pid: 8752 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583124.271446:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8442:1874416435872640:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583124.271546:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092484c0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787583124.276296:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.276350:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413799296 00000100:00100000:3.0:1787583124.276372:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413799296 00010000:00010000:3.0:1787583124.276419:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f8f9256/0x19a47956376b6ffa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4494 expref: 10 pid: 8752 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583124.276490:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:3.0:1787583124.276502:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:2406:x1874416413799296:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583124.276517:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583124.276539:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f8f9256/0x19a47956376b6ffa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4494 expref: 10 pid: 8752 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.276554:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f8f9256/0x19a47956376b6ffa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4494 expref: 10 pid: 8752 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.276769:0:6513:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583124.276775:0:6513:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583124.276786:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.276796:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.276835:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583124.277043:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eb9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6513:1874416435872768:192.168.203.11@tcp:105: 00000100:00100000:3.0:1787583124.277385:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91a80 going to sleep for 11 seconds 00010000:00010000:0.0:1787583124.277943:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f8f9256/0x19a47956376b6ffa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4494 expref: 10 pid: 8752 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583124.277961:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8442:1874416435872640:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583124.278014:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 9 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.278029:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a800, rc 0) 00000100:00100000:0.0:1787583124.278114:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:12431:x1874416413799168:12345-192.168.203.11@tcp:101:bash.0 Request processed in 6855us (7035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583124.278123:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:3.0:1787583124.281277:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eb9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6513:1874416435872768:192.168.203.11@tcp:105: 00010000:00010000:3.0:1787583124.281321:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583124.281394:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2406:x1874416413799296:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 4893us (5105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583124.281405:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:1.0:1787583124.289199:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.289294:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413799552 00000100:00100000:3.0:1787583124.289304:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413799552 00000100:00100000:3.0:1787583124.289416:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:3.0:1787583124.289427:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90924846b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+42:12431:x1874416413799552:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:3.0:1787583124.290646:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90924846b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:12431:x1874416413799552:12345-192.168.203.11@tcp:35:bash.0 Request processed in 1214us (1451us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787583124.290657:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:1.0:1787583124.469260:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.469371:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413799680 00000100:00100000:3.0:1787583124.469381:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413799680 00000100:00100000:3.0:1787583124.469452:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:3.0:1787583124.469463:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+43:12447:x1874416413799680:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1787583124.469487:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583124.469506:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b7008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44a2 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.469573:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b700f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.469588:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b700f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.469599:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b700f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583124.469663:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787583124.469667:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787583124.469700:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b700f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.469725:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b7008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44a2 expref: 45 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.469746:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b700f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44a2 expref: 44 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.469754:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:3.0:1787583124.469757:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787583124.469760:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248496a00, rc 0) 00000100:00100000:3.0:1787583124.469824:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+44:12447:x1874416413799680:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 362us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583124.469840:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:2.0:1787583124.473646:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583124.473807:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413799936 00000100:00100000:0.0:1787583124.473817:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413799936 00000100:00100000:0.0:1787583124.473924:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:0.0:1787583124.473936:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+44:12447:x1874416413799936:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583124.473958:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583124.473991:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b7016 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44a9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.474090:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b701d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.474104:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b701d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.474115:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b701d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583124.474126:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787583124.474231:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b7016 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44a9 expref: 47 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.474249:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b701d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44a9 expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.474274:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e3bec00) 00010000:00010000:0.0:1787583124.474277:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787583124.474280:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e800, rc 0) 00000100:00100000:0.0:1787583124.474333:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+46:12447:x1874416413799936:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 399us (698us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787583124.474340:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:0.0:1787583124.484539:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583124.484595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583124.484802:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413800320 00000100:00100000:1.0:1787583124.484813:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413800320 00000100:00100000:1.0:1787583124.484929:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1787583124.484941:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+46:2405:x1874416413800320:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583124.484958:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583124.484996:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b701d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44a9 expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.485016:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e3bec00) 00010000:00010000:1.0:1787583124.485037:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583124.485095:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+45:2405:x1874416413800320:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 157us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583124.485103:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:3.0:1787583124.487296:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413800192 00000100:00100000:3.0:1787583124.487310:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413800192 00000100:00100000:3.0:1787583124.487389:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 218 00000100:00100000:3.0:1787583124.487400:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+45:12447:x1874416413800192:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1787583124.487423:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583124.487443:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b702b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44b0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.487544:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496200/0x19a47956376b7032 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.487582:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496200/0x19a47956376b7032 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.487595:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496200/0x19a47956376b7032 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583124.487611:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787583124.488084:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b702b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44b0 expref: 48 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.488103:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496200/0x19a47956376b7032 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44b0 expref: 47 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.488112:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e3bec00) 00010000:00010000:3.0:1787583124.488115:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787583124.488118:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248496200, rc 0) 00000100:00100000:3.0:1787583124.488184:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+47:12447:x1874416413800192:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 786us (3655us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1787583124.488191:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 218 00000100:00100000:0.0:1787583124.506345:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.506456:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413800448 00000100:00100000:3.0:1787583124.506467:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413800448 00000100:00100000:3.0:1787583124.506536:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1787583124.506547:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2407:x1874416413800448:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:3.0:1787583124.506595:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.506617:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.506640:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583124.506655:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787583124.506660:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.506700:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.506715:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 8 pid: 8442 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583124.506732:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8445:1874416435872896:192.168.203.11@tcp:104: 00000100:00100000:3.0:1787583124.506835:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91300 going to sleep for 11 seconds 00000100:00100000:3.0:1787583124.517128:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8445:1874416435872896:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583124.517162:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583124.521172:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583124.521381:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413800576 00000100:00100000:1.0:1787583124.521392:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413800576 00002000:00100000:1.0:1787583124.521464:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff909247ef4e00 x1874416413800576/t0(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:590/0 lens 504/0 e 0 to 0 dl 1787583135 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787583124.521476:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff909247ef4e00 with x1874416413800576 ext(0->8) 00010000:00010000:1.0:1787583124.521485:0:8449:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 9 pid: 8442 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.521509:0:8449:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 9 pid: 8442 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787583124.521517:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff909247ef4e00 00000100:00100000:1.0:1787583124.521551:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1787583124.521560:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2406:x1874416413800576:12345-192.168.203.11@tcp:4:lfs.0 00000100:00100000:1.0:1787583124.523586:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:2406:x1874416413800576:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 2014us (2409us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787583124.523601:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00002000:00100000:1.0:1787583124.523613:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff909247ef4e00 x1874416413800576/t4294967309(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:590/0 lens 504/448 e 0 to 0 dl 1787583135 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787583124.523623:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff909247ef4e00 with x1874416413800576 ext(0->8) 00010000:00010000:1.0:1787583124.523632:0:8449:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 11 pid: 8442 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.523660:0:8449:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 11 pid: 8442 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787583124.523668:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff909247ef4e00 00000100:00100000:1.0:1787583124.532530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.532772:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413800704 00000100:00100000:2.0:1787583124.532784:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413800704 00010000:00010000:2.0:1787583124.532826:0:13742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 11 pid: 8442 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583124.532905:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:2.0:1787583124.532917:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:2407:x1874416413800704:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583124.532948:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787583124.532966:0:13742:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787583124.532969:0:13742:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787583123 00002000:00010000:2.0:1787583124.532972:0:13742:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787583123 00002000:00010000:2.0:1787583124.532974:0:13742:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787583123 00002000:00010000:2.0:1787583124.532977:0:13742:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787583124.532983:0:13742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 11 pid: 8442 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.532998:0:13742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 11 pid: 8442 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.533020:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a1b56d2/0x19a47956376b7001 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c449b expref: 11 pid: 8442 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.533037:0:13742:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787583124.533042:0:13742:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787583124.533048:0:13742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.533058:0:13742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.533094:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583124.533150:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:2407:x1874416413800704:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 235us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583124.533158:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 98 00010000:00010000:3.0:1787583124.533232:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.533242:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.533260:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.533274:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.533282:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.533289:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248497800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583124.533293:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.533302:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.533314:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.533322:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d1c7f15/0x19a47956376b7040 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583124.533378:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413800448:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 26833us (27043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583124.533387:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:2.0:1787583124.536622:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583124.536703:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413800960 00000100:00100000:0.0:1787583124.536713:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413800960 00000100:00100000:0.0:1787583124.536768:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:0.0:1787583124.536777:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373fa2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+47:12447:x1874416413800960:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:0.0:1787583124.536834:0:6531:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909248496200/0x19a47956376b7032 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44b0 expref: 47 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787583124.537063:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1787583124.537095:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787583124.537377:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1787583124.537414:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.537429:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b6fec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c448d expref: 51 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.537437:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.537501:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b6fec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c448d expref: 51 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.537514:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b6fec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c448d expref: 51 pid: 6528 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583124.537530:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6531:1874416435873024:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583124.537611:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7780 going to sleep for 11 seconds 00000100:00100000:1.0:1787583124.540740:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583124.541690:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6531:1874416435873024:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583124.541720:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583124.542684:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413801088 00000100:00100000:3.0:1787583124.542696:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413801088 00010000:00010000:3.0:1787583124.542740:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b6fec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c448d expref: 52 pid: 6528 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583124.542807:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:3.0:1787583124.542817:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+52:2406:x1874416413801088:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583124.542875:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583124.542884:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b6fec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c448d expref: 52 pid: 6528 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.542897:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b6fec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c448d expref: 52 pid: 6528 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.542919:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b6fec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c448d expref: 52 pid: 6528 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.542935:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e3bec00) 00010000:00010000:3.0:1787583124.542941:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.542950:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.542956:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.542976:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583124.543042:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+51:2406:x1874416413801088:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 226us (2309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583124.543049:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 99 00010000:00010000:0.0:1787583124.543180:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.543189:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787583124.543303:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1787583124.543431:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1787583124.543747:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874416435873152:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787583124.543806:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583124.543920:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435873152 00000100:00100000:1.0:1787583124.543927:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435873152 00000100:00100000:1.0:1787583124.543964:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787583124.543973:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6531:x1874416435873152:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787583124.544055:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6531:x1874416435873152:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583124.544061:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787583124.544276:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 11 seconds 00000100:00100000:0.0:1787583124.544303:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874416435873152:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787583124.544428:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1787583124.544490:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874416435873280:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787583124.545691:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583124.545725:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583124.545769:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435873280 00000100:00100000:3.0:1787583124.545784:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435873280 00000100:00100000:3.0:1787583124.545862:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787583124.545873:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6531:x1874416435873280:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787583124.546247:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6531:x1874416435873280:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 375us (556us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787583124.546256:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787583124.547751:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874416435873280:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787583124.547824:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1787583124.548629:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.548641:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.548648:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.548654:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583124.548658:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.548665:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.548680:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e3bec00) 00010000:00010000:2.0:1787583124.548683:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787583124.548687:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.548693:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7047 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787583124.548811:0:6531:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787583124.549064:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1787583124.549076:0:6531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431702229768ns, next at 432702227348ns, rc = 0 00000001:00080000:2.0:1787583124.549085:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1787583124.549124:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e3bec00) 00010000:00010000:2.0:1787583124.549127:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787583124.549134:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496200/0x19a47956376b7032 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44b0 expref: 55 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583124.549400:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373fa2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:12447:x1874416413800960:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 12623us (12787us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787583124.549436:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000020:00080000:2.0:1787583124.549462:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787583124.555751:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583124.556000:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413801216 00000100:00100000:0.0:1787583124.556012:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413801216 00000100:00100000:0.0:1787583124.556268:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 219 00000100:00100000:0.0:1787583124.556279:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+54:12447:x1874416413801216:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583124.556300:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583124.556324:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b704e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44b7 expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.556393:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b704e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44b7 expref: 55 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.556407:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b704e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44b7 expref: 55 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.556425:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583124.556428:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787583124.556432:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f000, rc 0) 00000100:00100000:0.0:1787583124.556498:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+55:12447:x1874416413801216:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 220us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583124.556506:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 219 00000100:00100000:1.0:1787583124.559897:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.560205:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413801472 00000100:00100000:3.0:1787583124.560215:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413801472 00000100:00100000:3.0:1787583124.560270:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:3.0:1787583124.560281:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+55:12447:x1874416413801472:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1787583124.560517:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+56:12447:x1874416413801472:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 237us (670us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787583124.560525:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:1.0:1787583124.650023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.650117:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413801600 00000100:00100000:2.0:1787583124.650128:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413801600 00000100:00100000:2.0:1787583124.650190:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 220 00000100:00100000:2.0:1787583124.650200:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+56:12457:x1874416413801600:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:2.0:1787583124.650274:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7055 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650290:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7055 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650302:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7055 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650321:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b705c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650329:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b705c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650335:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b705c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650433:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7063 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650440:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7063 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650444:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7063 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787583124.650488:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7063 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650501:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7055 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650509:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7055 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650516:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7055 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650522:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770ae00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583124.650526:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7055 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650533:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7055 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650544:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583124.650548:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583124.650552:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7055 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650564:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7055 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650592:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b705c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650599:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b705c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650805:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b705c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650813:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583124.650816:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b705c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650822:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b705c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650831:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff909343053a00) 00010000:00010000:2.0:1787583124.650833:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583124.650836:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b705c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650842:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b705c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650990:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7063 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.650996:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7063 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.651009:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7063 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.651014:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583124.651018:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7063 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.651024:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7063 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.651033:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:2.0:1787583124.651035:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583124.651038:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7063 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.651043:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7063 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583124.651157:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+56:12457:x1874416413801600:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 958us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583124.651166:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 220 00000100:00100000:1.0:1787583124.688571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.688748:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413801856 00000100:00100000:3.0:1787583124.688759:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413801856 00000100:00100000:3.0:1787583124.688966:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:3.0:1787583124.688979:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+56:12460:x1874416413801856:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1787583124.689001:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583124.689024:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b706a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44be expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689097:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b7071 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689111:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b7071 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689123:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b7071 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689134:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b7078 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689172:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b7078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689180:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b7078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689295:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497000/0x19a47956376b707f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689304:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248497000/0x19a47956376b707f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689311:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497000/0x19a47956376b707f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583124.689319:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787583124.689405:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b7071 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689413:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b7071 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689420:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b7071 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689426:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248497800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583124.689431:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b7071 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689438:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b7071 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689461:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:3.0:1787583124.689464:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583124.689468:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b7071 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689474:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b7071 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689488:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b7078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689494:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b7078 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689499:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b7078 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689504:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248497e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583124.689506:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b7078 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689512:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b7078 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689518:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff909343053a00) 00010000:00010000:3.0:1787583124.689520:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583124.689523:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b7078 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689527:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b7078 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689573:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b706a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44be expref: 59 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689588:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497000/0x19a47956376b707f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44be expref: 58 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.689595:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:3.0:1787583124.689598:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787583124.689600:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248497000, rc 0) 00000100:00100000:3.0:1787583124.689689:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:12460:x1874416413801856:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 713us (1128us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787583124.689696:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:0.0:1787583124.697512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583124.698187:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413801984 00000100:00100000:1.0:1787583124.698199:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413801984 00000100:00100000:1.0:1787583124.698278:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:1.0:1787583124.698288:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:12460:x1874416413801984:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:1.0:1787583124.698524:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b708d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.698542:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b708d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.698574:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b708d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.698774:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b708d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.698782:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b708d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.698789:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b708d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.698795:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583124.698800:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b708d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.698808:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b708d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.698831:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:1.0:1787583124.698834:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787583124.698839:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b708d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.698871:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b708d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583124.699001:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:12460:x1874416413801984:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 713us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583124.699010:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:0.0:1787583124.701951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.702053:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413802240 00000100:00100000:3.0:1787583124.702064:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413802240 00000100:00100000:3.0:1787583124.702115:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:3.0:1787583124.702125:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+58:12460:x1874416413802240:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1787583124.702394:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:12460:x1874416413802240:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 270us (453us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1787583124.702403:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:0.0:1787583124.808085:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.808366:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413802496 00000100:00100000:2.0:1787583124.808376:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413802496 00000100:00100000:2.0:1787583124.808439:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:2.0:1787583124.808450:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:12470:x1874416413802496:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1787583124.808474:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583124.808477:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787583124.808503:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496a00/0x19a47956376b700f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44a2 expref: 59 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.808542:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583124.808546:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583124.808558:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7094 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44c5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.808659:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b709b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.808672:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b709b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.808682:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b709b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583124.808692:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787583124.809092:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b7094 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44c5 expref: 61 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.809108:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b709b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44c5 expref: 60 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.809116:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:2.0:1787583124.809119:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583124.809122:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a800, rc 0) 00000100:00100000:2.0:1787583124.809329:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:12470:x1874416413802496:12345-192.168.203.11@tcp:101:bash.0 Request processed in 880us (1254us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787583124.809338:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:0.0:1787583124.813069:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583124.813109:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.813168:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413802624 00000100:00100000:2.0:1787583124.813186:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413802624 00000100:00100000:2.0:1787583124.813247:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1787583124.813257:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:2406:x1874416413802624:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583124.813271:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583124.813295:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b709b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44c5 expref: 60 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.813314:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:2.0:1787583124.813319:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583124.813375:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:2406:x1874416413802624:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 119us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583124.813383:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1787583124.813884:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413802752 00000100:00100000:3.0:1787583124.813890:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413802752 00000100:00100000:3.0:1787583124.813924:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 224 00000100:00100000:3.0:1787583124.813932:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+59:12470:x1874416413802752:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1787583124.813956:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583124.813974:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b70a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44cc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.814019:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b70b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.814031:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b70b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.814041:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b70b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.814140:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b70a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44cc expref: 61 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.814156:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b70b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44cc expref: 60 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.814164:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:3.0:1787583124.814167:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787583124.814169:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248497e00, rc 0) 00000100:00100000:3.0:1787583124.814528:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:12470:x1874416413802752:12345-192.168.203.11@tcp:101:bash.0 Request processed in 596us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583124.814536:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 224 00000100:00100000:0.0:1787583124.818825:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583124.819121:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413803008 00000100:00100000:1.0:1787583124.819132:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413803008 00000100:00100000:1.0:1787583124.819204:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 225 00000100:00100000:1.0:1787583124.819215:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+60:12470:x1874416413803008:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:1.0:1787583124.819266:0:13828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583124.819292:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497000/0x19a47956376b707f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44be expref: 60 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.819311:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:1.0:1787583124.819315:0:13828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583124.819488:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b70b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.819501:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b70b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.819512:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b70b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787583124.819556:0:13828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1787583124.819589:0:13828:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015f71e8d reply state 000000003525fe46 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b70b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.819602:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b70b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.819609:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:1.0:1787583124.819611:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787583124.819614:0:13828:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787583124.820114:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:12470:x1874416413803008:12345-192.168.203.11@tcp:36:bash.0 Request processed in 899us (1297us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787583124.820136:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 225 00000020:00080000:1.0:1787583124.820141:0:13828:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787583124.822165:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.822230:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413803136 00000100:00100000:3.0:1787583124.822240:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413803136 00000100:00100000:1.0:1787583124.822316:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 226 00000100:00100000:1.0:1787583124.822327:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+62:12470:x1874416413803136:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1787583124.822368:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583124.822389:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b70be lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44d3 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.822474:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b70c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.822493:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b70c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.822505:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b70c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583124.822533:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787583124.822538:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787583124.822554:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b70c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.822580:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52400/0x19a47956376b70be lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44d3 expref: 64 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.822597:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b70c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44d3 expref: 63 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583124.822623:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:1.0:1787583124.822626:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787583124.822630:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53e00, rc 0) 00000100:00100000:1.0:1787583124.822685:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:12470:x1874416413803136:12345-192.168.203.11@tcp:101:bash.0 Request processed in 359us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583124.822692:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 226 00000100:00100000:0.0:1787583124.828141:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.828267:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413803392 00000100:00100000:3.0:1787583124.828278:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413803392 00000100:00100000:3.0:1787583124.828331:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:3.0:1787583124.828341:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+63:12470:x1874416413803392:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:3.0:1787583124.828790:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+64:12470:x1874416413803392:12345-192.168.203.11@tcp:35:bash.0 Request processed in 448us (657us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1787583124.828797:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00010000:00010000:2.0:1787583124.880968:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583124.892573:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.892656:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413803520 00000100:00100000:3.0:1787583124.892666:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413803520 00000100:00100000:3.0:1787583124.892731:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:3.0:1787583124.892742:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+64:12476:x1874416413803520:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1787583124.892769:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583124.892789:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b70cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44da expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.892924:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b70d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.892938:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b70d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.892949:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b70d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583124.892989:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787583124.892993:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787583124.893011:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b70d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.893035:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b70cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44da expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.893053:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b70d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44da expref: 65 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.893068:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:3.0:1787583124.893071:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787583124.893074:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248497800, rc 0) 00000100:00100000:3.0:1787583124.893137:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12476:x1874416413803520:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 397us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583124.893144:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:1.0:1787583124.907150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583124.907240:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413803648 00000100:00100000:0.0:1787583124.907250:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413803648 00000100:00100000:0.0:1787583124.907308:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 228 00000100:00100000:0.0:1787583124.907318:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12476:x1874416413803648:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1787583124.907337:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583124.907365:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b70da lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44e1 expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907428:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b70e1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907442:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b70e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907453:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b70e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907465:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b70e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907473:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b70e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907480:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b70e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907569:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907590:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907598:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583124.907640:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787583124.907653:0:13828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583124.907670:0:13828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907681:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907689:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b70e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907695:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b70e1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907702:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b70e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907707:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583124.907711:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b70e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907840:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b70e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907906:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:0.0:1787583124.907909:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583124.907914:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b70e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907920:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b70e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907932:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b70e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907938:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b70e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907943:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b70e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907948:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583124.907951:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b70e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907956:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b70e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907963:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff909343053a00) 00010000:00010000:0.0:1787583124.907965:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583124.907967:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b70e8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.907972:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b70e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.908008:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b70da lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e1 expref: 67 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.908021:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e1 expref: 66 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.908028:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583124.908030:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787583124.908033:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fa00, rc 0) 00000100:00100000:0.0:1787583124.908102:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12476:x1874416413803648:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 784us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583124.908110:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 228 00000100:00100000:1.0:1787583124.913249:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.913459:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413803904 00000100:00100000:3.0:1787583124.913469:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413803904 00000100:00100000:3.0:1787583124.913530:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 229 00000100:00100000:3.0:1787583124.913540:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12476:x1874416413803904:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1787583124.913558:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583124.913578:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b70f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44e8 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583124.913909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1787583124.914364:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.914382:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b70c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44d3 expref: 67 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.914392:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e1 expref: 67 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.914401:0:7748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.914437:0:7748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e1 expref: 67 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.914466:0:7748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e1 expref: 67 pid: 13828 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583124.914483:0:7748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435873408:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583124.914579:0:7748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b70c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44d3 expref: 67 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.914588:0:7748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b70c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44d3 expref: 67 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583124.914597:0:7748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435873536:192.168.203.11@tcp:104: 00000100:00100000:3.0:1787583124.914621:0:7748:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91180 going to sleep for 11 seconds 00000100:00100000:0.0:1787583124.915132:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413804032 00000100:00100000:0.0:1787583124.915140:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413804032 00010000:00010000:0.0:1787583124.915168:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e1 expref: 68 pid: 13828 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583124.915199:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:0.0:1787583124.915208:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+68:2406:x1874416413804032:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583124.915218:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583124.915224:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e1 expref: 68 pid: 13828 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.915236:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e1 expref: 68 pid: 13828 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.915267:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583124.915272:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.915280:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.915286:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583124.915328:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+68:2406:x1874416413804032:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 122us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583124.915336:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 100 00010000:00010000:3.0:1787583124.918399:0:7748:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.11@tcp) returned -22 from blocking AST (req@0000000089da4594 x1874416435873408) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e1 expref: 67 pid: 13828 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.918424:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b70ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e1 expref: 67 pid: 13828 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583124.918442:0:7748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435873408:192.168.203.11@tcp:104: 00000100:00100000:1.0:1787583124.919959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.920076:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413804160 00000100:00100000:2.0:1787583124.920085:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413804160 00010000:00010000:2.0:1787583124.920122:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b70c5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44d3 expref: 67 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583124.920158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:2.0:1787583124.920168:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093770b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+67:2407:x1874416413804160:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583124.920185:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583124.920191:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b70c5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44d3 expref: 67 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.920203:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b70c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44d3 expref: 67 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.920244:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:2.0:1787583124.920249:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.920260:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.920268:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.920288:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583124.920341:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093770b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+67:2407:x1874416413804160:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 175us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583124.920348:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 101 00010000:00010000:3.0:1787583124.920678:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b70c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44d3 expref: 66 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583124.920692:0:7748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1874416435873536:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583124.920731:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:3.0:1787583124.920738:0:7748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.920746:0:7748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.920752:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583124.920771:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787583124.920942:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b70f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e8 expref: 67 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.920959:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e8 expref: 66 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.920966:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:3.0:1787583124.920969:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787583124.920972:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248496c00, rc 0) 00000100:00100000:3.0:1787583124.921004:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12476:x1874416413803904:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 7466us (7763us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787583124.921011:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 229 00000100:00100000:1.0:1787583124.924463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583124.924559:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413804416 00000100:00100000:0.0:1787583124.924570:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413804416 00000100:00100000:0.0:1787583124.924641:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1787583124.924659:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12476:x1874416413804416:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:0.0:1787583124.924675:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583124.924700:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b704e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44b7 expref: 66 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583124.924730:0:13742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583124.924735:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583124.924791:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12476:x1874416413804416:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 133us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583124.924799:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1787583124.927320:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583124.927405:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413804544 00000100:00100000:2.0:1787583124.927414:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413804544 00000100:00100000:2.0:1787583124.927475:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 230 00000100:00100000:2.0:1787583124.927485:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12476:x1874416413804544:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:2.0:1787583124.927592:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b710b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.927608:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b710b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583124.927620:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b710b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787583124.927733:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787583124.927816:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12476:x1874416413804544:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 332us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583124.927837:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 230 00000100:00100000:1.0:1787583124.930335:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583124.930416:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413804672 00000100:00100000:3.0:1787583124.930425:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413804672 00000100:00100000:3.0:1787583124.930484:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 231 00000100:00100000:3.0:1787583124.930495:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+65:12476:x1874416413804672:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1787583124.930514:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583124.930548:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497a00/0x19a47956376b7112 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.930604:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b710b lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.930615:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248497a00/0x19a47956376b7112 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44ef expref: 66 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.930633:0:6529:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b710b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.930658:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497a00/0x19a47956376b7112 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44ef expref: 66 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.930670:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:3.0:1787583124.930673:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787583124.930677:0:6529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff909248497a00/0x19a47956376b7112 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44ef expref: 66 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583124.930684:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248497a00, rc 0) 00000100:00100000:3.0:1787583124.930899:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12476:x1874416413804672:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 404us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583124.930906:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 231 00000040:00080000:3.0:1787583125.070128:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787583125.070137:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787583125.070161:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787583125.070172:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787583125.070298:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eb9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874416435873664:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787583125.070705:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c919c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583125.076842:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.077057:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eb9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874416435873664:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787583125.077664:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413804800 00000100:00100000:0.0:1787583125.077693:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413804800 00000100:00100000:0.0:1787583125.077766:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:0.0:1787583125.077776:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12477:x1874416413804800:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787583125.077807:0:7748:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787583125.077937:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12477:x1874416413804800:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 161us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583125.077944:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:1.0:1787583125.081440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583125.082274:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413804928 00000100:00100000:0.0:1787583125.082284:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413804928 00000100:00100000:0.0:1787583125.082346:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:0.0:1787583125.082366:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12477:x1874416413804928:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787583125.082430:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b7119 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082444:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b7119 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082454:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b7119 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082480:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7120 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082487:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7120 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082493:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7120 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082512:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7127 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082534:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082540:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583125.082820:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787583125.082825:0:13828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583125.082838:0:13828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082928:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b7119 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082936:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b7119 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082942:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b7119 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082947:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583125.082952:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b7119 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082959:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b7119 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082970:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90937e015500) 00010000:00010000:0.0:1787583125.082973:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583125.082978:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b7119 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.082995:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b7119 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083009:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7120 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083015:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7120 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083020:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7120 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083025:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583125.083027:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7120 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083033:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7120 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083039:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff90937e013700) 00010000:00010000:0.0:1787583125.083041:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583125.083044:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7120 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083050:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b7120 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083066:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083071:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7127 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083081:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7127 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083086:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583125.083088:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7127 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083093:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7127 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083221:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583125.083225:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583125.083228:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7127 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.083234:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7127 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583125.083313:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12477:x1874416413804928:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 946us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583125.083322:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:1.0:1787583125.086289:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.086399:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413805184 00000100:00100000:3.0:1787583125.086409:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413805184 00000100:00100000:3.0:1787583125.086661:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 234 00000100:00100000:3.0:1787583125.086672:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365c7f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+66:12477:x1874416413805184:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787583125.086693:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583125.086729:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b712e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44f6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.086827:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b7135 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.086842:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b7135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.086885:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b7135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583125.086896:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787583125.086970:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b7135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.086979:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b7135 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.086985:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b7135 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.086991:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248496e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583125.087008:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b7135 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.087015:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b7135 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.087027:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:3.0:1787583125.087030:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787583125.087034:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b7135 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.087039:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b7135 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.087081:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b712e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44f6 expref: 68 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.087091:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90937e015500) 00010000:00010000:3.0:1787583125.087093:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787583125.087097:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b712e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44f6 expref: 68 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.087118:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248496000, rc 0) 00000100:00100000:3.0:1787583125.087167:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365c7f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+67:12477:x1874416413805184:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 498us (886us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1787583125.087174:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 234 00000100:00100000:1.0:1787583125.092134:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583125.092534:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413805312 00000100:00100000:0.0:1787583125.092544:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413805312 00000100:00100000:0.0:1787583125.092629:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 235 00000100:00100000:0.0:1787583125.092651:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+67:12477:x1874416413805312:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787583125.092687:0:6527:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787583125.093040:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+67:12477:x1874416413805312:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 400us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583125.093067:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 235 00000100:00100000:1.0:1787583125.096476:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583125.098242:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413805568 00000100:00100000:0.0:1787583125.098258:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413805568 00000100:00100000:2.0:1787583125.098409:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 236 00000100:00100000:2.0:1787583125.098422:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+67:12477:x1874416413805568:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583125.098441:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583125.098444:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787583125.098469:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497800/0x19a47956376b70d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44da expref: 67 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.098490:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583125.098494:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583125.098506:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7143 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c44fd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787583125.099448:0:6527:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787583125.100091:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b714a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.100176:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b714a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.100188:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b714a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.100250:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7143 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44fd expref: 69 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.100267:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b714a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44fd expref: 68 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.100298:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff909343053100) 00010000:00010000:2.0:1787583125.100301:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583125.100305:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770ba00, rc 0) 00000100:00100000:2.0:1787583125.100437:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+68:12477:x1874416413805568:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 2017us (3998us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787583125.100445:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 236 00000100:00100000:1.0:1787583125.106738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.106884:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413805824 00000100:00100000:3.0:1787583125.106894:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413805824 00000100:00100000:3.0:1787583125.106957:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00100000:3.0:1787583125.106968:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+68:12477:x1874416413805824:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787583125.107046:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583125.107076:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b714a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44fd expref: 68 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107094:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff909343053100) 00010000:00010000:3.0:1787583125.107113:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787583125.107134:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b7158 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107146:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b7158 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107154:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b7158 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107213:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b715f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6ca60319 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107222:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b715f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6ca60319 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107229:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b715f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6ca60319 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107271:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b7158 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107278:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b7158 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107285:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b7158 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107297:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248496000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583125.107301:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b7158 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107308:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b7158 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107317:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:3.0:1787583125.107320:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583125.107323:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b7158 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107328:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b7158 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107339:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b715f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6ca60319 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107345:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b715f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6ca60319 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107350:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b715f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6ca60319 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107364:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248496e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583125.107367:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b715f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6ca60319 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107372:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b715f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6ca60319 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107392:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6ca60319 (ffff90937e3be500) 00010000:00010000:3.0:1787583125.107395:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787583125.107397:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b715f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6ca60319 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.107402:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b715f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6ca60319 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583125.107480:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+67:12477:x1874416413805824:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 514us (750us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787583125.107488:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00100000:1.0:1787583125.110937:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583125.111015:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413805952 00000100:00100000:0.0:1787583125.111024:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413805952 00000100:00100000:0.0:1787583125.111074:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:0.0:1787583125.111083:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+67:12477:x1874416413805952:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787583125.111111:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583125.111132:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7166 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4504 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.111163:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b716d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.111175:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b716d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.111185:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b716d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.111291:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e800/0x19a47956376b7166 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4504 expref: 69 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.111307:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b716d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4504 expref: 68 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.111315:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:0.0:1787583125.111318:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787583125.111326:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f600, rc 0) 00000100:00100000:0.0:1787583125.111385:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+68:12477:x1874416413805952:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 303us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583125.111392:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:1.0:1787583125.115577:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583125.115671:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413806208 00000100:00100000:2.0:1787583125.115680:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413806208 00000100:00100000:2.0:1787583125.115747:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 239 00000100:00100000:2.0:1787583125.115758:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+68:12477:x1874416413806208:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787583125.115839:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7174 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.116402:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.116418:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787583125.116772:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:2.0:1787583125.116828:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca3c7284 reply state 00000000a6710527 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.116841:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7174 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.116868:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:2.0:1787583125.116871:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787583125.116889:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787583125.117325:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+70:12477:x1874416413806208:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1566us (1764us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787583125.117333:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 239 00000100:00100000:1.0:1787583125.120504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583125.120569:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413806336 00000100:00100000:0.0:1787583125.120588:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413806336 00000100:00100000:0.0:1787583125.120659:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00100000:0.0:1787583125.120670:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+70:12477:x1874416413806336:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787583125.120706:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583125.121206:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b717b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c450b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.121266:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b717b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c450b expref: 71 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.121305:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b717b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c450b expref: 71 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.121326:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:1.0:1787583125.121329:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787583125.121332:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52800, rc 0) 00000100:00100000:1.0:1787583125.121399:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+71:12477:x1874416413806336:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 731us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583125.121407:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00100000:1.0:1787583125.124937:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583125.125061:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413806464 00000100:00100000:0.0:1787583125.125070:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413806464 00000100:00080000:3.0:1787583125.125185:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583125.125260:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:0.0:1787583125.125271:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413806464:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787583125.125494:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:2407:x1874416413806464:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 223us (567us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787583125.125502:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:0.0:1787583125.128589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583125.128888:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413806720 00000100:00100000:2.0:1787583125.128899:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413806720 00000100:00100000:2.0:1787583125.128966:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1787583125.128977:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+71:12477:x1874416413806720:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787583125.129210:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+72:12477:x1874416413806720:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 234us (628us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1787583125.129349:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:1.0:1787583125.131951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.132039:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413806976 00000100:00100000:3.0:1787583125.132050:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413806976 00000100:00100000:3.0:1787583125.132124:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:3.0:1787583125.132136:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+72:12477:x1874416413806976:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787583125.132249:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+72:12477:x1874416413806976:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 114us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583125.132256:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:1.0:1787583125.135673:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583125.135803:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413807104 00000100:00100000:2.0:1787583125.135813:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413807104 00000100:00100000:2.0:1787583125.135901:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:2.0:1787583125.135913:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+72:12477:x1874416413807104:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583125.135933:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583125.135955:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b7182 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4512 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.136024:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b7189 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.136038:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b7189 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.136049:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b7189 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583125.136093:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583125.136143:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b7189 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.136171:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ba00/0x19a47956376b7182 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4512 expref: 74 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.136188:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b7189 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4512 expref: 73 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.136197:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:2.0:1787583125.136200:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787583125.136203:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a800, rc 0) 00000100:00100000:2.0:1787583125.136262:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+73:12477:x1874416413807104:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 351us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583125.136269:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:0.0:1787583125.139505:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583125.139592:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413807232 00000100:00100000:2.0:1787583125.139602:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413807232 00000100:00100000:2.0:1787583125.139661:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:2.0:1787583125.139672:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+10:2406:x1874416413807232:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583125.139692:0:8752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583125.139939:0:8752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd55842b/0x19a47956376b7190 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4519 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787583125.139967:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c5a93, blocks: 0x0 00010000:00010000:2.0:1787583125.139987:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1787583125.139992:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583125.140001:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd55842b/0x19a47956376b7190 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4519 expref: 11 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.140043:0:8752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd55842b/0x19a47956376b7190 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4519 expref: 11 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.140056:0:8752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dede00, rc 0) 00000100:00100000:2.0:1787583125.140127:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:2406:x1874416413807232:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 456us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583125.140134:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:1.0:1787583125.143786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.143938:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413807488 00000100:00100000:3.0:1787583125.143948:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413807488 00000100:00100000:3.0:1787583125.144010:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:3.0:1787583125.144022:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+73:12477:x1874416413807488:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787583125.144139:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+73:12477:x1874416413807488:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 119us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583125.144146:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:1.0:1787583125.147677:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583125.147905:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413807616 00000100:00100000:2.0:1787583125.147915:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413807616 00000100:00100000:2.0:1787583125.147972:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:2.0:1787583125.147983:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:12477:x1874416413807616:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583125.148001:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583125.148017:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4520 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.148046:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd55842b/0x19a47956376b7190 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4519 expref: 12 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.148054:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583125.148059:0:8442:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583125.148064:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4520 expref: 12 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.148094:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd55842b/0x19a47956376b7190 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4519 expref: 12 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.148227:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd55842b/0x19a47956376b7190 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4519 expref: 12 pid: 8752 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583125.148242:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8442:1874416435873792:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583125.148513:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092484c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583125.152555:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.152684:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413807744 00000100:00100000:3.0:1787583125.152702:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413807744 00010000:00010000:3.0:1787583125.152914:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd55842b/0x19a47956376b7190 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4519 expref: 13 pid: 8752 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583125.152959:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:3.0:1787583125.152970:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+13:2406:x1874416413807744:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583125.152984:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583125.153005:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd55842b/0x19a47956376b7190 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4519 expref: 13 pid: 8752 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.153020:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd55842b/0x19a47956376b7190 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4519 expref: 13 pid: 8752 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.153044:0:6513:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583125.153049:0:6513:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583125.153058:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4520 expref: 13 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.153068:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4520 expref: 13 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.153117:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4520 expref: 13 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583125.153132:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ebb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6513:1874416435873920:192.168.203.11@tcp:105: 00000100:00100000:3.0:1787583125.153387:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c919c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787583125.155601:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd55842b/0x19a47956376b7190 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4519 expref: 13 pid: 8752 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583125.155625:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8442:1874416435873792:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583125.155665:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4520 expref: 12 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.155680:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344deda00, rc 0) 00000100:00100000:2.0:1787583125.155989:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+12:12477:x1874416413807616:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 8006us (8320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583125.155999:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:3.0:1787583125.159416:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ebb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6513:1874416435873920:192.168.203.11@tcp:105: 00010000:00010000:3.0:1787583125.159441:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583125.159530:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:2406:x1874416413807744:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 6561us (6984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583125.159542:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:0.0:1787583125.160380:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.160627:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413807872 00000100:00100000:3.0:1787583125.160635:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413807872 00002000:00100000:3.0:1787583125.160839:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff909247ef4700 x1874416413807872/t0(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:591/0 lens 504/0 e 0 to 0 dl 1787583136 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787583125.160993:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff909247ef4700 with x1874416413807872 ext(0->12) 00002000:00010000:3.0:1787583125.160999:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff909247ef4700 00000100:00100000:2.0:1787583125.161271:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:2.0:1787583125.161284:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+11:2407:x1874416413807872:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787583125.163116:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+13:2407:x1874416413807872:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 1818us (2723us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787583125.163130:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00002000:00100000:3.0:1787583125.163139:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff909247ef4700 x1874416413807872/t4294967321(0) o4->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:591/0 lens 504/448 e 0 to 0 dl 1787583136 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787583125.163148:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff909247ef4700 with x1874416413807872 ext(0->12) 00002000:00010000:3.0:1787583125.163153:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff909247ef4700 00000100:00100000:3.0:1787583125.165830:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583125.166077:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413808000 00000100:00100000:2.0:1787583125.166087:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413808000 00000100:00100000:2.0:1787583125.166147:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 244 00000100:00100000:2.0:1787583125.166156:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+73:12477:x1874416413808000:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787583125.168555:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1787583125.168600:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787583125.168621:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90936f1f7000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787583125.168626:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff909377135a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90936f1f7240 00000020:00080000:1.0:1787583125.168629:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff909351059f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff909344b4a200 00000004:00080000:1.0:1787583125.168766:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787583125.168803:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90937cd26000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787583125.168806:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90936e14e600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff909350a78c00 00000020:00080000:1.0:1787583125.168809:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90936e14ef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90937e017a00 00000020:00080000:1.0:1787583125.168827:0:6506:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1787583125.169034:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:12477:x1874416413808000:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 2874us (3207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583125.169044:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 244 00000020:00080000:3.0:1787583125.170242:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787583125.170310:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787583125.170333:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435874176:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787583125.170398:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583125.170439:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787583125.170457:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435874048:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787583125.170481:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583125.171427:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435874176 00000100:00100000:2.0:1787583125.171437:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435874176 00000100:00100000:2.0:1787583125.171500:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435874048 00000100:00100000:2.0:1787583125.171504:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435874048 00000100:00100000:2.0:1787583125.171531:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787583125.171539:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937e5a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3656:x1874416435874176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787583125.171568:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1787583125.171599:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c5a93, atime: 0x6a8c5a93, ctime: 0x6a8c5a93, blocks: 0x8 00010000:00010000:2.0:1787583125.171606:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfd6e3f2/0x19a47956376b719e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.171622:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1787583125.171627:0:8445:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583125.171634:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfd6e3f2/0x19a47956376b719e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.171810:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfd6e3f2/0x19a47956376b719e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.171820:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfd6e3f2/0x19a47956376b719e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.171828:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfd6e3f2/0x19a47956376b719e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.171874:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787583125.172031:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937e5a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3656:x1874416435874176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 491us (1631us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787583125.172050:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787583125.172197:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787583125.172207:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3656:x1874416435874048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787583125.172221:0:8752:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1787583125.172235:0:8752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.172249:0:8752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6f52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4478 expref: 12 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.172257:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787583125.172260:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787583125.172264:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.172294:0:8752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6f52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4478 expref: 12 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.172308:0:8752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4478 expref: 12 pid: 8442 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583125.172321:0:8752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8752:1874416435874304:192.168.203.11@tcp:104: 00000100:00100000:1.0:1787583125.172393:0:8752:0:(client.c:2715:ptlrpc_set_wait()) set ffff90934562b9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787583125.172924:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583125.172931:0:10405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfd6e3f2/0x19a47956376b719e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.172941:0:10405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583125.172946:0:10405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfd6e3f2/0x19a47956376b719e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.172955:0:10405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfd6e3f2/0x19a47956376b719e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.172971:0:10405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfd6e3f2/0x19a47956376b719e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.172979:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfd6e3f2/0x19a47956376b719e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.172997:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583125.172999:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583125.173000:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787583125.173032:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff909247f82300/2, rc 0, transno 4294967311 00000100:00100000:2.0:1787583125.173038:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435874176:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1787583125.173264:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787583125.173269:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583125.173318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583125.176371:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413808128 00000100:00100000:2.0:1787583125.176386:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413808128 00000100:00100000:2.0:1787583125.176446:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:2.0:1787583125.176456:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+13:2407:x1874416413808128:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787583125.177309:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.178172:0:8752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8752:1874416435874304:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583125.178198:0:8752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178667:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178678:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178686:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178716:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344decc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583125.178721:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178729:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178745:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90937e3bee00) 00010000:00010000:0.0:1787583125.178748:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583125.178753:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e9c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178759:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b6e9c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178789:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178795:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178801:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178806:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583125.178809:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178815:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178834:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff909343053300) 00010000:00010000:0.0:1787583125.178836:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583125.178839:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f44 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178869:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b6f44 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178886:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6fc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178892:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6fc2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178898:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6fc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178903:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583125.178906:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6fc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178912:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6fc2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178920:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff909343053a00) 00010000:00010000:0.0:1787583125.178922:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583125.178925:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6fc2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178930:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a600/0x19a47956376b6fc2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178953:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496400/0x19a47956376b6fe5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178959:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496400/0x19a47956376b6fe5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178964:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248496400/0x19a47956376b6fe5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178968:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248496400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583125.178971:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496400/0x19a47956376b6fe5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178976:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496400/0x19a47956376b6fe5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178983:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff909343053a00) 00010000:00010000:0.0:1787583125.178985:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583125.178988:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248496400/0x19a47956376b6fe5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.178993:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496400/0x19a47956376b6fe5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179023:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b70b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179030:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b70b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179035:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b70b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179045:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583125.179048:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b70b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179054:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b70b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179063:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583125.179065:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583125.179068:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b70b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179073:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b70b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179086:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7174 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179091:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7174 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179265:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7174 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179273:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770ae00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583125.179276:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7174 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179283:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7174 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179303:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:0.0:1787583125.179305:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787583125.179307:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7174 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179313:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ae00/0x19a47956376b7174 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583125.179337:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413808256 00000100:00100000:0.0:1787583125.179345:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413808256 00010000:00010000:0.0:1787583125.179386:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4478 expref: 14 pid: 8442 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583125.179418:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:0.0:1787583125.179426:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+14:2407:x1874416413808256:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583125.179439:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583125.179444:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4478 expref: 14 pid: 8442 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179456:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6f52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4478 expref: 14 pid: 8442 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179475:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0176d18/0x19a47956376b6f52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4478 expref: 14 pid: 8442 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179487:0:6512:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583125.179496:0:6512:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583125.179502:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179512:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.179542:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583125.179610:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+13:2407:x1874416413808256:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 183us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583125.179617:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 103 00010000:00010000:3.0:1787583125.180658:0:8752:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.180674:0:8752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.180685:0:8752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.180692:0:8752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.180723:0:8752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787583125.181157:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3656:x1874416435874048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8948us (10671us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787583125.181167:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1787583125.181544:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583125.181552:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.181570:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53e00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583125.181575:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.181584:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.181604:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.181612:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a594b1e/0x19a47956376b71a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.181659:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583125.181661:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583125.181663:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787583125.181943:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff909247ee4700/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787583125.181955:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435874048:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787583125.182826:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1787583125.183048:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:2.0:1787583125.183268:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413808128:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 6808us (9945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583125.183279:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:2.0:1787583125.186501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.186586:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413808512 00000100:00100000:3.0:1787583125.186595:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413808512 00000100:00100000:3.0:1787583125.186715:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:3.0:1787583125.186726:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:12477:x1874416413808512:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787583125.186796:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583125.186821:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a800/0x19a47956376b7189 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4512 expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.186837:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:3.0:1787583125.186842:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787583125.186911:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b71ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.186926:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b71ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.186936:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b71ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787583125.187053:0:7748:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001becd012 reply state 0000000065d543b1 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b71ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.187064:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b71ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.187071:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:3.0:1787583125.187073:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787583125.187075:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787583125.187281:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:12477:x1874416413808512:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 556us (787us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1787583125.187288:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:1.0:1787583125.189387:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.189427:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413808640 00000100:00100000:3.0:1787583125.189437:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413808640 00000100:00100000:3.0:1787583125.189570:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:3.0:1787583125.189595:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413808640:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787583125.189744:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787583125.189748:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787583123 00002000:00010000:3.0:1787583125.189750:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787583123 00002000:00010000:3.0:1787583125.189753:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787583123 -> 1787583123 00002000:00010000:3.0:1787583125.189755:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787583125.189808:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2407:x1874416413808640:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 212us (425us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787583125.189817:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:1.0:1787583125.194691:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583125.194903:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413808896 00000100:00100000:0.0:1787583125.194913:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413808896 00000100:00100000:0.0:1787583125.195036:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:0.0:1787583125.195047:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:12477:x1874416413808896:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787583125.195107:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.195124:0:13828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b716d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4504 expref: 22 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.195134:0:13828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.195170:0:13828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b716d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4504 expref: 22 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.195183:0:13828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b716d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4504 expref: 22 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583125.195197:0:13828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435874432:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583125.195341:0:13828:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7480 going to sleep for 11 seconds 00000100:00100000:0.0:1787583125.200337:0:13828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435874432:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583125.200375:0:13828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583125.201190:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583125.201467:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413809024 00000100:00100000:2.0:1787583125.201476:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413809024 00010000:00010000:2.0:1787583125.201514:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b716d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4504 expref: 23 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583125.201555:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:2.0:1787583125.201565:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+23:2406:x1874416413809024:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583125.201587:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583125.201594:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b716d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4504 expref: 23 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.201607:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b716d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4504 expref: 23 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.201627:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f600/0x19a47956376b716d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4504 expref: 23 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.201653:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:2.0:1787583125.201658:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.201679:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.201686:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.201767:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583125.201828:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:2406:x1874416413809024:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 264us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583125.201837:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 104 00010000:00010000:0.0:1787583125.202002:0:13828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.202010:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.202047:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.202054:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.202061:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.202067:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fa00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583125.202071:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.202078:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.202087:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:0.0:1787583125.202090:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787583125.202094:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.202441:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b71b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583125.202630:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:12477:x1874416413808896:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 7583us (7956us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787583125.202651:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:1.0:1787583125.204741:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583125.205225:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413809152 00000100:00100000:2.0:1787583125.205235:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413809152 00000100:00100000:2.0:1787583125.205294:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:2.0:1787583125.205306:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2406:x1874416413809152:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787583125.205364:0:8752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.205384:0:8752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4520 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.205392:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583125.205396:0:8752:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787583125.205400:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.205434:0:8752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4520 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.205469:0:8752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4520 expref: 8 pid: 8442 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583125.205485:0:8752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8752:1874416435874560:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583125.205561:0:8752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092484c09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583125.209097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.209228:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413809280 00000100:00100000:3.0:1787583125.209237:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413809280 00010000:00010000:3.0:1787583125.209272:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4520 expref: 9 pid: 8442 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583125.209319:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:3.0:1787583125.209329:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413809280:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583125.209343:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583125.209373:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4520 expref: 9 pid: 8442 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.209388:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4520 expref: 9 pid: 8442 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.209411:0:6513:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787583125.209416:0:6513:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787583125.209423:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.209452:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.209474:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583125.209532:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413809280:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 203us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583125.209539:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 105 00010000:00010000:1.0:1787583125.210929:0:8752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9256f3/0x19a47956376b7197 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4520 expref: 8 pid: 8442 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583125.210950:0:8752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8752:1874416435874560:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583125.210973:0:8752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.210983:0:8752:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.210991:0:8752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.211016:0:8752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.211025:0:8752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.211032:0:8752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.211056:0:8752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344decc00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787583125.211061:0:8752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.211069:0:8752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.211087:0:8752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583125.211094:0:8752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b302898/0x19a47956376b71ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583125.211408:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413809152:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 6104us (6674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583125.211417:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:2.0:1787583125.214365:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583125.214514:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413809536 00000100:00100000:1.0:1787583125.214524:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413809536 00000100:00100000:3.0:1787583125.214791:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 247 00000100:00100000:3.0:1787583125.214804:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:12477:x1874416413809536:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787583125.214901:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.214918:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b70b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44cc expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.214928:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.214964:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b70b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44cc expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.214978:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b70b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44cc expref: 21 pid: 6528 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583125.214993:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ebbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435874688:192.168.203.11@tcp:104: 00000100:00100000:3.0:1787583125.215076:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787583125.224444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583125.224552:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ebbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435874688:192.168.203.11@tcp:104: 00010000:00010000:1.0:1787583125.224586:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583125.224952:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413809664 00000100:00100000:2.0:1787583125.224960:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413809664 00010000:00010000:2.0:1787583125.224998:0:13742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b70b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44cc expref: 22 pid: 6528 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583125.225035:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:2.0:1787583125.225046:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:2406:x1874416413809664:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583125.225060:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583125.225067:0:13742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b70b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44cc expref: 22 pid: 6528 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.225079:0:13742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b70b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44cc expref: 22 pid: 6528 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.225763:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497e00/0x19a47956376b70b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44cc expref: 22 pid: 6528 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.225789:0:13742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:2.0:1787583125.225811:0:13742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff909248497a00/0x19a47956376b7112 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44ef expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.225821:0:13742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.225828:0:13742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.225835:0:13742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.226080:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787583125.226377:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.226386:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.226545:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.226557:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b717b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c450b expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.226575:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.226602:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b717b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c450b expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.226615:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b717b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c450b expref: 22 pid: 6528 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583125.226628:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435874816:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583125.226688:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:2406:x1874416413809664:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1644us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583125.226704:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:3.0:1787583125.229735:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787583125.233248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583125.233321:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413809792 00000100:00100000:0.0:1787583125.233329:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413809792 00010000:00010000:0.0:1787583125.233377:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b717b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c450b expref: 22 pid: 6528 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583125.233418:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:0.0:1787583125.233427:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093770b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:2407:x1874416413809792:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583125.233441:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583125.233448:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b717b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c450b expref: 22 pid: 6528 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.233461:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b717b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c450b expref: 22 pid: 6528 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.233484:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:0.0:1787583125.233489:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.233498:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.233506:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.233525:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583125.233589:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093770b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:2407:x1874416413809792:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 162us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583125.233615:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 107 00010000:00010000:3.0:1787583125.235233:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52800/0x19a47956376b717b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c450b expref: 21 pid: 6528 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583125.235253:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435874816:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583125.235273:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.235295:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.235301:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787583125.235408:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1787583125.235515:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1787583125.235549:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1787583125.235799:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874416435874944:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787583125.236213:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583125.236279:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583125.236338:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435874944 00000100:00100000:0.0:1787583125.236346:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435874944 00000100:00100000:0.0:1787583125.236409:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787583125.236419:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6528:x1874416435874944:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787583125.236504:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6528:x1874416435874944:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583125.236510:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787583125.236576:0:6528:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:3.0:1787583125.236582:0:6528:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:3.0:1787583125.236620:0:6528:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff909247ee4700 x1874416435874048/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787583141 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583125.236631:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874416435874944:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787583125.236758:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1787583125.236803:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874416435875072:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787583125.236830:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583125.236879:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583125.237050:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435875072 00000100:00100000:0.0:1787583125.237056:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435875072 00000100:00100000:0.0:1787583125.237090:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787583125.237105:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6528:x1874416435875072:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787583125.237199:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6528:x1874416435875072:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (368us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787583125.237205:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787583125.237450:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874416435875072:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787583125.237484:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237493:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237514:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237519:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248496800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583125.237523:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237530:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237544:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:3.0:1787583125.237547:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787583125.237551:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237556:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71c8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237590:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b710b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237597:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b710b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237603:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b710b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237608:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:3.0:1787583125.237611:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b710b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237627:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b710b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237646:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:3.0:1787583125.237648:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787583125.237655:0:6528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff909248497a00/0x19a47956376b7112 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44ef expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237664:0:6528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497a00/0x19a47956376b7112 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44ef expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237674:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248497a00/0x19a47956376b7112 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44ef expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.237841:0:6528:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff909248497a00/0x19a47956376b7112 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44ef expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583125.237892:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435875200:192.168.203.11@tcp:105: 00000100:00100000:3.0:1787583125.237951:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff90937cd26d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787583125.240891:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874416435875200:192.168.203.11@tcp:105: 00010000:00010000:0.0:1787583125.240920:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b710b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.240931:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b600/0x19a47956376b710b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.240964:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b71cf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.240977:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b71cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241006:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b71cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241016:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b71cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241022:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b71cf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241029:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b71cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241035:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713e600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583125.241039:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b71cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241046:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b71cf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241057:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583125.241060:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583125.241064:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b71cf lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241069:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e600/0x19a47956376b71cf lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241078:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241085:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241095:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241167:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248496000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583125.241171:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241178:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241187:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583125.241190:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787583125.241192:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.241198:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71c1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583125.241371:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:12477:x1874416413809536:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 26569us (27022us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787583125.241381:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 247 00000020:00080000:0.0:1787583125.241387:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787583125.241536:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787583125.241541:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787583125.242196:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787583125.242209:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787583125.248732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.248883:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413810048 00000100:00100000:3.0:1787583125.248892:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413810048 00000100:00100000:3.0:1787583125.248948:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1787583125.248958:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+24:12477:x1874416413810048:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787583125.249231:0:6530:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787583125.249263:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1787583125.249293:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b71d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.249309:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b71d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.249320:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b71d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.249329:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b71d6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.249336:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b71d6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.249342:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b71d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.249370:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787583125.249442:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+26:12477:x1874416413810048:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 485us (718us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787583125.249451:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000020:00080000:3.0:1787583125.249455:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787583125.250053:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583125.250061:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b71d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.250069:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248497c00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583125.250073:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b71d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.250091:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b71d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.250104:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:0.0:1787583125.250107:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787583125.250111:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b71d6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.250116:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b71d6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583125.250129:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583125.250131:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583125.250132:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583125.250684:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.250975:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413810176 00000100:00100000:3.0:1787583125.250982:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413810176 00000100:00100000:3.0:1787583125.251027:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:3.0:1787583125.251035:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373fa1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+26:12476:x1874416413810176:12345-192.168.203.11@tcp:49:lfs.0 00000100:00100000:3.0:1787583125.251139:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373fa1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+26:12476:x1874416413810176:12345-192.168.203.11@tcp:49:lfs.0 Request processed in 104us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583125.251156:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1787583125.259888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.260146:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413810432 00000100:00100000:3.0:1787583125.260157:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413810432 00000100:00100000:3.0:1787583125.260247:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:3.0:1787583125.260258:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+26:12476:x1874416413810432:12345-192.168.203.11@tcp:58:lfs.0 00000040:00080000:3.0:1787583125.260465:0:7748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787583125.260558:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+26:12476:x1874416413810432:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 301us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583125.260566:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:0.0:1787583125.293483:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.293574:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413810560 00000100:00100000:3.0:1787583125.293584:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413810560 00000100:00100000:3.0:1787583125.293644:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:3.0:1787583125.293654:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+26:12479:x1874416413810560:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1787583125.293672:0:13828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583125.293690:0:13828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4527 expref: -99 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.293949:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497600/0x19a47956376b71e4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.293964:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248497600/0x19a47956376b71e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.293975:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497600/0x19a47956376b71e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.293990:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496600/0x19a47956376b71eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.294015:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248496600/0x19a47956376b71eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.294022:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496600/0x19a47956376b71eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.294087:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497400/0x19a47956376b71f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.294098:0:13828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e8 expref: 27 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.294107:0:13828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248497400/0x19a47956376b71f2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.294140:0:13828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e8 expref: 27 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583125.294153:0:13828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e8 expref: 27 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583125.294167:0:13828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ebb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435875328:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583125.294578:0:13828:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247c91300 going to sleep for 11 seconds 00000100:00100000:0.0:1787583125.305670:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583125.305824:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413810816 00000100:00100000:3.0:1787583125.305835:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413810816 00000100:00100000:3.0:1787583125.305937:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:3.0:1787583125.305948:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+28:6175:x1874416413810816:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787583125.306170:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:6175:x1874416413810816:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 223us (508us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787583125.306194:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1787583125.306603:0:13828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ebb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13828:1874416435875328:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583125.306630:0:13828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909248497400/0x19a47956376b71f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583125.308178:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583125.308274:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413810944 00000100:00100000:2.0:1787583125.308283:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413810944 00010000:00010000:2.0:1787583125.308322:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e8 expref: 29 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583125.308375:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:2.0:1787583125.308384:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:2406:x1874416413810944:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583125.308414:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583125.308422:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e8 expref: 29 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308434:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e8 expref: 29 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308456:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496c00/0x19a47956376b70fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44e8 expref: 29 pid: 7748 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308474:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:2.0:1787583125.308478:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909248497400/0x19a47956376b71f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308486:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497400/0x19a47956376b71f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308493:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248497400/0x19a47956376b71f2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308517:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583125.308563:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+28:2406:x1874416413810944:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 180us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583125.308581:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 108 00010000:00010000:2.0:1787583125.308607:0:13828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909248497400/0x19a47956376b71f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308614:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497400/0x19a47956376b71f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583125.308683:0:13828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787583125.308688:0:13828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583125.308931:0:13828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909248497400/0x19a47956376b71f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308946:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248497400/0x19a47956376b71f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308956:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497600/0x19a47956376b71e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308962:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248497600/0x19a47956376b71e4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308968:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248497600/0x19a47956376b71e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308974:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248497600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583125.308978:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248497600/0x19a47956376b71e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308985:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248497600/0x19a47956376b71e4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.308995:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:2.0:1787583125.308998:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583125.309002:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248497600/0x19a47956376b71e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.309008:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497600/0x19a47956376b71e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.309029:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496600/0x19a47956376b71eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.309036:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496600/0x19a47956376b71eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.309041:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248496600/0x19a47956376b71eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.309046:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248496600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583125.309049:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496600/0x19a47956376b71eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.309055:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496600/0x19a47956376b71eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.309064:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90937e3be500) 00010000:00010000:2.0:1787583125.309066:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583125.309069:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248496600/0x19a47956376b71eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.309075:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496600/0x19a47956376b71eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.309113:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496800/0x19a47956376b71dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4527 expref: 28 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.309126:0:13828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497400/0x19a47956376b71f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4527 expref: 27 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583125.309145:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:2.0:1787583125.309147:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583125.309150:0:13828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248497400, rc 0) 00000100:00100000:2.0:1787583125.309179:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:12479:x1874416413810560:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 15527us (15705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583125.309186:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 249 00010000:00010000:1.0:1787583125.902614:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787583125.940372:0:14718:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787583125.940387:0:14718:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787583125.940423:0:14718:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787583125.940430:0:14718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787583126.285952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583126.285993:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583126.286023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583126.286053:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413811200 00000100:00100000:3.0:1787583126.286061:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413811200 00000100:00100000:3.0:1787583126.286114:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413811712 00000100:00100000:3.0:1787583126.286117:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413811712 00000100:00100000:3.0:1787583126.286144:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 317 00000100:00100000:3.0:1787583126.286154:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:2407:x1874416413811200:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583126.286198:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 318 00000100:00100000:1.0:1787583126.286207:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413811712:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583126.286225:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:2407:x1874416413811200:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583126.286230:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413811712:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583126.286233:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 317 00000100:00100000:1.0:1787583126.286237:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 318 00000100:00080000:3.0:1787583126.286255:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583126.286394:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413811456 00000100:00100000:2.0:1787583126.286399:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413811456 00000100:00100000:2.0:1787583126.286434:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:2.0:1787583126.286441:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413811456:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583126.286483:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2407:x1874416413811456:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 42us (488us total) trans 0 rc 0/0 00000040:00080000:0.0:1787583126.286488:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:2.0:1787583126.286489:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 144 00000040:00080000:0.0:1787583126.286493:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787583126.286520:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787583126.286526:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787583126.286703:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874416435875456:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787583126.286780:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092484c06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583126.287754:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583126.287792:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583126.287823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583126.287884:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583126.287907:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413811328 00000100:00100000:3.0:1787583126.287913:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413811328 00000100:00100000:3.0:1787583126.287948:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413811840 00000100:00100000:3.0:1787583126.287951:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413811840 00000100:00100000:3.0:1787583126.287971:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 319 00000100:00100000:3.0:1787583126.287979:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413811328:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583126.288025:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2407:x1874416413811328:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 46us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583126.288046:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 319 00000100:00100000:3.0:1787583126.288062:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 320 00000100:00100000:3.0:1787583126.288068:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413811840:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583126.288093:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2407:x1874416413811840:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583126.288099:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 320 00000100:00080000:3.0:1787583126.288119:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787583126.288298:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413811072 00000100:00100000:2.0:1787583126.288302:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413811072 00000100:00100000:2.0:1787583126.288341:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 387 00000100:00100000:2.0:1787583126.288362:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937702a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2407:x1874416413811072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583126.288390:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937702a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2407:x1874416413811072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583126.288396:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 387 00000100:00100000:1.0:1787583126.288522:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413811584 00000100:00100000:1.0:1787583126.288526:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413811584 00000100:00100000:1.0:1787583126.288571:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:1.0:1787583126.288579:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413811584:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583126.288605:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+9:2407:x1874416413811584:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583126.288611:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00080000:3.0:1787583126.288919:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787583126.300606:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874416435875456:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787583126.301230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583126.301544:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413811968 00000100:00100000:2.0:1787583126.301553:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413811968 00000100:00100000:2.0:1787583126.301612:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:2.0:1787583126.301621:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:12492:x1874416413811968:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787583126.301662:0:6527:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787583126.301777:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:12492:x1874416413811968:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 154us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583126.301785:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:0.0:1787583126.311141:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583126.311938:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413812224 00000100:00100000:3.0:1787583126.311949:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413812224 00000100:00100000:3.0:1787583126.312012:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:3.0:1787583126.312024:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+27:12492:x1874416413812224:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787583126.312044:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583126.312064:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c452e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583126.312175:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b7200 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583126.312189:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b7200 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583126.312200:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b7200 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583126.312211:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787583126.312317:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496000/0x19a47956376b71f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c452e expref: 30 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583126.312336:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b7200 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c452e expref: 29 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583126.312354:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:3.0:1787583126.312357:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787583126.312361:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248497c00, rc 0) 00000100:00100000:3.0:1787583126.312431:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:12492:x1874416413812224:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 409us (1300us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787583126.312441:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:1.0:1787583126.316335:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583126.316481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583126.316541:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413812608 00000100:00100000:2.0:1787583126.316551:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413812608 00000100:00100000:2.0:1787583126.316631:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1787583126.316647:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:2405:x1874416413812608:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583126.316663:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583126.316688:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497c00/0x19a47956376b7200 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c452e expref: 29 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583126.316709:0:13742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:2.0:1787583126.316713:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583126.316878:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+28:2405:x1874416413812608:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 200us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583126.316886:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:0.0:1787583126.317104:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413812480 00000100:00100000:0.0:1787583126.317109:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413812480 00000100:00100000:0.0:1787583126.317149:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:0.0:1787583126.317157:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+28:12492:x1874416413812480:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787583126.317220:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b720e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583126.317234:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b720e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583126.317260:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b720e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583126.317592:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b720e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583126.317665:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b720e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583126.317673:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b720e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583126.317679:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583126.317683:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b720e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583126.317751:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b720e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583126.317763:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583126.317765:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787583126.317770:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b720e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583126.317776:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b720e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583126.317941:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:12492:x1874416413812480:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 783us (1619us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787583126.317949:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 252 00000040:00080000:2.0:1787583126.317983:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787583126.317988:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787583126.318482:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787583126.318490:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787583126.320409:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583126.320703:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413812864 00000100:00100000:3.0:1787583126.320713:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413812864 00000100:00100000:3.0:1787583126.320806:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:3.0:1787583126.320817:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+29:12492:x1874416413812864:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787583126.321062:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+30:12492:x1874416413812864:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 246us (660us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787583126.321070:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:2.0:1787583126.478253:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435875584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787583126.478352:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583126.478496:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435875584 00000100:00100000:1.0:1787583126.478504:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435875584 00000100:00100000:1.0:1787583126.478561:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787583126.478572:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435875584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787583126.478605:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787583126.478650:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435875584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583126.478657:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787583126.478765:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435875584:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787583126.926063:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787583127.005399:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1787583127.005416:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1787583127.502193:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435875712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583127.502283:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583127.502529:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435875712 00000100:00100000:0.0:1787583127.502538:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435875712 00000100:00100000:0.0:1787583127.502599:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787583127.502610:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435875712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583127.502639:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787583127.502686:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435875712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583127.502693:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1787583127.502796:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583127.502837:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435875712:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1787583127.508134:0:8751:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 434661284510ns, next at 435661281911ns, rc = 0 00000100:00100000:1.0:1787583127.508159:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787583127.508178:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435875840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583127.510000:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583127.510125:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435875840 00000100:00100000:2.0:1787583127.510134:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435875840 00000100:00100000:2.0:1787583127.510185:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787583127.510194:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937e7d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1874416435875840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583127.510227:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787583127.510281:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937e7d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1874416435875840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583127.510288:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1787583127.510785:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583127.510828:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435875840:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787583127.784301:0:14769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787583127.784310:0:14769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787583127.784351:0:14769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787583127.784357:0:14769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787583127.913743:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583127.913832:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413813120 00000100:00100000:1.0:1787583127.913841:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413813120 00000100:00100000:1.0:1787583127.913933:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 253 00000100:00100000:1.0:1787583127.913944:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+30:12512:x1874416413813120:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1787583127.913966:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583127.913986:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b7215 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4535 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583127.914088:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b721c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583127.914112:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b721c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583127.914126:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b721c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583127.914138:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787583127.914257:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52600/0x19a47956376b7215 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4535 expref: 33 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583127.914274:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b721c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4535 expref: 32 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583127.914283:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:1.0:1787583127.914293:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787583127.914297:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53e00, rc 0) 00000100:00100000:1.0:1787583127.914360:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:12512:x1874416413813120:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 418us (625us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787583127.914368:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 253 00000100:00100000:3.0:1787583127.916493:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583127.916584:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413813248 00000100:00100000:0.0:1787583127.916602:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413813248 00000100:00100000:0.0:1787583127.916686:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 254 00000100:00100000:0.0:1787583127.916696:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:12512:x1874416413813248:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1787583127.916750:0:13828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b722a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583127.916764:0:13828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b722a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583127.916784:0:13828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b722a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583127.916817:0:13828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b722a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583127.916823:0:13828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b722a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583127.916831:0:13828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b722a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583127.916874:0:13828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583127.916878:0:13828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b722a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583127.916885:0:13828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b722a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583127.916897:0:13828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583127.917002:0:13828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787583127.917008:0:13828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b722a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583127.917014:0:13828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b722a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583127.917085:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+32:12512:x1874416413813248:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 389us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583127.917093:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 254 00010000:00010000:0.0:1787583127.950073:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583127.996998:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583127.997046:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413813376 00000100:00100000:3.0:1787583127.997054:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413813376 00000100:00100000:3.0:1787583127.997114:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:3.0:1787583127.997124:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2405:x1874416413813376:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:3.0:1787583127.997141:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583127.997170:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000483b63b4/0x19a47956376b7231 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c453c expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787583127.997195:0:8444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8c5a93, atime: 0x6a8c5a93, ctime: 0x6a8c5a93, blocks: 0x8 00010000:00010000:3.0:1787583127.997214:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1787583127.997219:0:8444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583127.997230:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000483b63b4/0x19a47956376b7231 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c453c expref: 8 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583127.997246:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000483b63b4/0x19a47956376b7231 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c453c expref: 8 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583127.997259:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248496000, rc 0) 00000100:00100000:3.0:1787583127.997317:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2405:x1874416413813376:12345-192.168.203.11@tcp:101:cat.0 Request processed in 194us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583127.997324:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00080000:3.0:1787583127.997355:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583128.008127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583128.008350:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413813504 00000100:00100000:2.0:1787583128.008361:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413813504 00002000:00100000:2.0:1787583128.008408:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff909247ebb100 x1874416413813504/t0(0) o3->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:594/0 lens 488/0 e 0 to 0 dl 1787583139 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787583128.008418:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff909247ebb100 with x1874416413813504 ext(0->4095) 00002000:00010000:2.0:1787583128.008424:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff909247ebb100 00000100:00100000:2.0:1787583128.008495:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1787583128.008504:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2407:x1874416413813504:12345-192.168.203.11@tcp:3:cat.0 00000100:00100000:2.0:1787583128.008649:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+8:2407:x1874416413813504:12345-192.168.203.11@tcp:3:cat.0 Request processed in 146us (529us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787583128.008657:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00002000:00100000:2.0:1787583128.008664:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff909247ebb100 x1874416413813504/t0(0) o3->c54c7da2-d1ec-4db9-98d7-e170a1f2cfae@192.168.203.11@tcp:594/0 lens 488/4536 e 0 to 0 dl 1787583139 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787583128.008673:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff909247ebb100 with x1874416413813504 ext(0->4095) 00002000:00010000:2.0:1787583128.008683:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff909247ebb100 00000100:00100000:2.0:1787583128.526128:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787583128.526153:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435875968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583128.526239:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583128.526260:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435876224:0@lo:400:kworker.0 00000100:00100000:2.0:1787583128.526292:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435876096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583128.526294:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583128.526315:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583128.526359:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435876096 00000100:00100000:1.0:1787583128.526359:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435875968 00000100:00100000:2.0:1787583128.526366:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435876096 00000100:00100000:1.0:1787583128.526366:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435875968 00000100:00100000:1.0:1787583128.526406:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787583128.526413:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787583128.526415:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435875968:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583128.526419:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435876096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787583128.526442:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:1.0:1787583128.526442:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583128.526490:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435875968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583128.526492:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435876096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583128.526497:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787583128.526497:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787583128.526529:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435876224 00000100:00100000:2.0:1787583128.526531:0:3655:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000100:00100000:1.0:1787583128.526532:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435876224 00000004:00080000:2.0:1787583128.526536:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000100:00100000:1.0:1787583128.526554:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787583128.526560:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435876224:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1787583128.526563:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff909247f8ce00, transno 4294967308 00000004:00080000:2.0:1787583128.526571:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1787583128.526581:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff909247f82300, transno 4294967311 00000100:00100000:2.0:1787583128.526592:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435875968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583128.526607:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435876096:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1787583128.526754:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787583128.526780:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435876352:0@lo:400:kworker.0 00000100:00100000:2.0:1787583128.526808:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583128.526866:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435876352 00000100:00100000:2.0:1787583128.526871:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435876352 00000100:00100000:2.0:1787583128.527811:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787583128.527824:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435876352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583128.528500:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435876352:12345-0@lo:400:kworker.0 Request processed in 677us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583128.528508:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787583128.528806:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435876352:0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.532152:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435876224:12345-0@lo:400:kworker.0 Request processed in 5581us (5846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583128.532167:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787583128.532434:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435876864:0@lo:400:kworker.0 00000100:00100000:0.0:1787583128.532490:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583128.532519:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435877376:0@lo:400:kworker.0 00000100:00100000:0.0:1787583128.532540:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583128.532560:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787583128.532566:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435876736:0@lo:400:kworker.0 00000100:00100000:0.0:1787583128.532586:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583128.532602:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435877248:0@lo:400:kworker.0 00000100:00100000:0.0:1787583128.532644:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583128.532672:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435876864 00000100:00100000:0.0:1787583128.532680:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435876864 00000100:00100000:0.0:1787583128.532722:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435877376 00000100:00100000:0.0:1787583128.532726:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435877376 00000100:00100000:0.0:1787583128.532739:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435876736 00000100:00100000:0.0:1787583128.532741:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435876736 00000100:00100000:0.0:1787583128.532751:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435877248 00000100:00100000:0.0:1787583128.532753:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435877248 00000100:00100000:0.0:1787583128.532766:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787583128.532774:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435876864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583128.532824:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435876864:12345-0@lo:400:kworker.0 Request processed in 50us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583128.532830:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787583128.532875:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787583128.532882:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435877376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583128.532910:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435877376:12345-0@lo:400:kworker.0 Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583128.532916:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787583128.532930:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787583128.532935:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435876736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583128.532960:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435876736:12345-0@lo:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583128.532966:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787583128.532977:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787583128.532983:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435877248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583128.533008:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435877248:12345-0@lo:400:kworker.0 Request processed in 26us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583128.533020:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00080000:0.0:1787583128.533043:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787583128.533047:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787583128.533078:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435876736:0@lo:400:kworker.0 00000100:00100000:0.0:1787583128.533088:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435877248:0@lo:400:kworker.0 00010000:00080000:0.0:1787583128.533098:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247ef7480 x1874416435876864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583128.533107:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435876864:0@lo:400:kworker.0 00010000:00080000:0.0:1787583128.533115:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247ef5880 x1874416435877376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583128.533122:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435877376:0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533262:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435876608:0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533289:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583128.533315:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435877120:0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533348:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583128.533369:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787583128.533375:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435876480:0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533396:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583128.533415:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435876992:0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533435:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583128.533450:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435877504:0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533467:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583128.533491:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435877120 00000100:00100000:1.0:1787583128.533495:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435877120 00000100:00100000:1.0:1787583128.533523:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435876992 00000100:00100000:1.0:1787583128.533525:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435876992 00000100:00100000:1.0:1787583128.533535:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435877504 00000100:00100000:1.0:1787583128.533537:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435877504 00000100:00100000:1.0:1787583128.533556:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787583128.533562:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3656:x1874416435877120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533595:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3656:x1874416435877120:12345-0@lo:400:kworker.0 Request processed in 34us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583128.533608:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787583128.533620:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787583128.533626:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435876992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533654:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435876992:12345-0@lo:400:kworker.0 Request processed in 28us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583128.533659:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787583128.533669:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787583128.533676:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435877504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533699:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435877504:12345-0@lo:400:kworker.0 Request processed in 24us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583128.533704:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787583128.533732:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435876992:0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533742:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435877504:0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533750:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435877120:0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533787:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435876480 00000100:00100000:1.0:1787583128.533791:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435876480 00000100:00100000:1.0:1787583128.533812:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787583128.533820:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435876480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583128.533894:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435876480:12345-0@lo:400:kworker.0 Request processed in 76us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583128.533901:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787583128.533923:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435876480:0@lo:400:kworker.0 00000100:00080000:0.0:1787583128.534020:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583128.534030:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435876608 00000100:00100000:0.0:1787583128.534033:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435876608 00000100:00100000:0.0:1787583128.534064:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787583128.534071:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435876608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583128.534107:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435876608:12345-0@lo:400:kworker.0 Request processed in 36us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583128.534112:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787583128.534136:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435876608:0@lo:400:kworker.0 00000100:00100000:3.0:1787583128.535748:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435876224:0@lo:400:kworker.0 00010000:00010000:2.0:1787583128.974061:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583129.038232:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787583129.038255:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435877632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583129.038319:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583129.038391:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435877632 00000100:00100000:2.0:1787583129.038398:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435877632 00000100:00100000:2.0:1787583129.038444:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787583129.038452:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435877632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583129.038473:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583129.038513:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435877632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583129.038520:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787583129.041778:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435877632:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787583130.000129:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787583130.580487:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1787583130.580502:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1787583130.590590:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000004:00080000:0.0:1787583130.590611:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1787583130.590668:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff909247c910c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787583130.590673:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff909347b22900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff909247c91180 00000020:00080000:0.0:1787583130.590677:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff909347b22100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff909247cc3e00 00000020:00080000:0.0:1787583130.590693:0:6506:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1787583130.590704:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787583130.590768:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1787583130.592401:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583130.592422:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435877760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787583130.592490:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583130.592554:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435877760 00000100:00100000:1.0:1787583130.592560:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435877760 00000100:00100000:1.0:1787583130.592623:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787583130.592632:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435877760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787583130.592761:0:8445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787583130.592765:0:8445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787583123 -> 1787583123 00002000:00010000:1.0:1787583130.592768:0:8445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1787583123 -> 1787583123 00002000:00010000:1.0:1787583130.592771:0:8445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787583123 -> 1787583123 00002000:00010000:1.0:1787583130.592773:0:8445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787583130.592821:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1874416435877760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (331us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787583130.592828:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1787583130.592876:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583130.592915:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787583130.592921:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff909247ee4700, transno 4294967322 00000004:00080000:1.0:1787583130.592929:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787583130.592948:0:3654:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90937fc63480 x1874416435877760/t4294967325(4294967325) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787583146 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787583130.592960:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90937fc63480/2, rc 0, transno 4294967325 00000100:00100000:1.0:1787583130.592965:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435877760:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1787583130.596072:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b71ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583130.596088:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b71ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583130.596095:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b71ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583130.596114:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248496e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583130.596127:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b71ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583130.596136:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b71ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583130.596153:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90937e013700) 00010000:00010000:2.0:1787583130.596156:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583130.596160:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b71ac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583130.596166:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248496e00/0x19a47956376b71ac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583131.023047:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583131.406412:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583131.406470:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583131.406506:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583131.406536:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583131.406583:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583131.406601:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583131.406627:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583131.406654:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413813888 00000100:00100000:3.0:1787583131.406662:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413813888 00000100:00100000:3.0:1787583131.406709:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413814400 00000100:00100000:3.0:1787583131.406711:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413814400 00000100:00100000:3.0:1787583131.406723:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413813760 00000100:00100000:3.0:1787583131.406726:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413813760 00000100:00100000:3.0:1787583131.406735:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413814272 00000100:00100000:3.0:1787583131.406737:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413814272 00000100:00100000:3.0:1787583131.406752:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 327 00000100:00100000:3.0:1787583131.406761:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413813888:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583131.406828:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413813888:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583131.406987:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 328 00000100:00100000:0.0:1787583131.406997:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b124cdab-8363-4433-96a8-2d8722f1634b+5:2404:x1874416413814400:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583131.407026:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b124cdab-8363-4433-96a8-2d8722f1634b+5:2404:x1874416413814400:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583131.407032:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 328 00000100:00100000:0.0:1787583131.407049:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 329 00000100:00100000:0.0:1787583131.407055:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:2404:x1874416413813760:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583131.407079:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:2404:x1874416413813760:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583131.407085:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 329 00000100:00100000:0.0:1787583131.407096:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 330 00000100:00100000:0.0:1787583131.407102:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b124cdab-8363-4433-96a8-2d8722f1634b+5:2404:x1874416413814272:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583131.407125:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b124cdab-8363-4433-96a8-2d8722f1634b+5:2404:x1874416413814272:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583131.407130:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 330 00000100:00100000:1.0:1787583131.407389:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413814144 00000100:00100000:1.0:1787583131.407394:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413814144 00000100:00100000:1.0:1787583131.407431:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413814016 00000100:00100000:1.0:1787583131.407434:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413814016 00000100:00100000:1.0:1787583131.407454:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:1.0:1787583131.407470:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413814144:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583131.407506:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2404:x1874416413814144:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 37us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583131.407512:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:1.0:1787583131.407524:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:1.0:1787583131.407530:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2404:x1874416413814016:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1787583131.407552:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2404:x1874416413814016:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583131.407558:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00080000:1.0:1787583131.407576:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787583131.407579:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787583131.407582:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787583131.407584:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787583131.407709:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 327 00000100:00100000:2.0:1787583131.408376:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413813632 00000100:00100000:2.0:1787583131.408382:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413813632 00000100:00100000:2.0:1787583131.408425:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 389 00000100:00100000:2.0:1787583131.408434:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909377029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2404:x1874416413813632:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583131.408488:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909377029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa77711a-a697-4098-9892-32db59b6905c+13:2404:x1874416413813632:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 55us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583131.408495:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 389 00000100:00100000:1.0:1787583131.599949:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435877888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583131.600023:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583131.600275:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435877888 00000100:00100000:2.0:1787583131.600284:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435877888 00000100:00100000:2.0:1787583131.600346:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787583131.600355:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435877888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787583131.600387:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787583131.600437:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435877888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583131.600460:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787583131.600507:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435877888:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787583132.046831:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583132.622785:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435878016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583132.622871:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583132.622946:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435878016 00000100:00100000:3.0:1787583132.622953:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435878016 00000100:00100000:3.0:1787583132.623019:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787583132.623029:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435878016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787583132.623055:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787583132.623099:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435878016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583132.623106:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1787583132.623126:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583132.623162:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435878016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787583132.628096:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787583132.628118:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435878144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787583132.628183:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583132.629513:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435878144 00000100:00100000:0.0:1787583132.629523:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435878144 00000100:00100000:0.0:1787583132.629611:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787583132.629621:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435878144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583132.629645:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787583132.629711:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435878144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583132.629718:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787583132.629768:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435878144:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787583132.629942:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583132.975971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583132.976304:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413814528 00000100:00100000:2.0:1787583132.976314:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413814528 00000100:00100000:2.0:1787583132.977750:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 255 00000100:00100000:2.0:1787583132.977768:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:12165:x1874416413814528:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787583132.977894:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:12165:x1874416413814528:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 132us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583132.977902:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 255 00000100:00100000:3.0:1787583132.980723:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583132.981455:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413814656 00000100:00100000:1.0:1787583132.981465:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413814656 00000100:00100000:1.0:1787583132.981516:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 256 00000100:00100000:1.0:1787583132.981528:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:12165:x1874416413814656:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787583132.981629:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:12165:x1874416413814656:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 103us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583132.981636:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 256 00000100:00100000:1.0:1787583132.983238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583132.985879:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413814912 00000100:00100000:3.0:1787583132.985892:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413814912 00000100:00100000:1.0:1787583132.986425:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:1.0:1787583132.986438:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:12165:x1874416413814912:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787583132.986684:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:12165:x1874416413814912:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 248us (3451us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787583132.986692:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00010000:00010000:2.0:1787583133.070046:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583133.186942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583133.187024:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413815040 00000100:00100000:2.0:1787583133.187033:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413815040 00000100:00080000:3.0:1787583133.187107:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583133.187107:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 257 00000100:00100000:2.0:1787583133.187123:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:12968:x1874416413815040:12345-192.168.203.11@tcp:101:lsof.0 00010000:00010000:2.0:1787583133.187141:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583133.187159:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b7238 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4543 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583133.187216:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b723f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583133.187228:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b723f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583133.187254:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b723f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583133.187315:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787583133.187319:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583133.187343:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b723f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583133.187367:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344decc00/0x19a47956376b7238 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4543 expref: 7 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583133.187385:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b723f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4543 expref: 6 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583133.187393:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013400) 00010000:00010000:2.0:1787583133.187396:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787583133.187399:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344deda00, rc 0) 00000100:00100000:2.0:1787583133.187461:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+6:12968:x1874416413815040:12345-192.168.203.11@tcp:101:lsof.0 Request processed in 343us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583133.187467:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 257 00000040:00080000:3.0:1787583133.519571:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787583133.519582:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787583133.519656:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1787583133.519662:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787583133.520355:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787583133.646352:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435878400:0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.646368:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435878272:0@lo:400:kworker.0 00000100:00100000:2.0:1787583133.646521:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435878656:0@lo:400:kworker.0 00000100:00100000:1.0:1787583133.646996:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435878528:0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.649727:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583133.649795:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435878784:0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.649837:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583133.650194:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435879296:0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.650221:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583133.650243:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435879808:0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.650265:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583133.650304:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583133.650311:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435879936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787583133.650332:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583133.650369:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435879296 00000100:00100000:0.0:1787583133.650376:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435879296 00000100:00100000:0.0:1787583133.650418:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435879808 00000100:00100000:0.0:1787583133.650421:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435879808 00000100:00100000:0.0:1787583133.650466:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787583133.650488:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435879296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.650549:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435879296:12345-0@lo:400:kworker.0 Request processed in 62us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583133.650556:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787583133.650572:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787583133.650577:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435879808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.650610:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435879808:12345-0@lo:400:kworker.0 Request processed in 34us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583133.650615:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787583133.650655:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435879296:0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.650663:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435879808:0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.650705:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435878272 00000100:00100000:0.0:1787583133.650709:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435878272 00000100:00100000:0.0:1787583133.650732:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1787583133.650737:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435878272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.650768:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435878272:12345-0@lo:400:kworker.0 Request processed in 31us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583133.650773:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1787583133.650801:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435878272:0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.650834:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435878784 00000100:00100000:0.0:1787583133.650838:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435878784 00000100:00100000:0.0:1787583133.650880:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435879936 00000100:00100000:0.0:1787583133.650883:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435879936 00000100:00100000:0.0:1787583133.650894:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787583133.650899:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435878784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.650943:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435878784:12345-0@lo:400:kworker.0 Request processed in 44us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583133.650949:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787583133.650961:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787583133.650966:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435879936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787583133.650989:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787583133.651017:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435879936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583133.651023:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787583133.651060:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435879936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583133.651065:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583133.651076:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435878784:0@lo:400:kworker.0 00000100:00080000:3.0:1787583133.651096:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583133.651154:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435878912:0@lo:400:kworker.0 00000100:00100000:3.0:1787583133.651182:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583133.651198:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435879424:0@lo:400:kworker.0 00000100:00100000:3.0:1787583133.651218:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583133.651478:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435878400 00000100:00100000:0.0:1787583133.651483:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435878400 00000100:00100000:0.0:1787583133.651565:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435878912 00000100:00100000:0.0:1787583133.651569:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435878912 00000100:00100000:0.0:1787583133.651737:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435879424 00000100:00100000:0.0:1787583133.651742:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435879424 00000100:00100000:0.0:1787583133.651760:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787583133.651766:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435878400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.651807:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435878400:12345-0@lo:400:kworker.0 Request processed in 41us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583133.651813:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787583133.651826:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787583133.651832:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435878912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.652226:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435878912:12345-0@lo:400:kworker.0 Request processed in 393us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583133.652242:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787583133.652257:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787583133.652263:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435879424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.652307:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435879424:12345-0@lo:400:kworker.0 Request processed in 44us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583133.652313:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00080000:0.0:1787583133.652343:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787583133.652380:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435878400:0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.652392:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435878912:0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.652401:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435879424:0@lo:400:kworker.0 00000100:00100000:1.0:1787583133.659029:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583133.659156:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435879040:0@lo:400:kworker.0 00000100:00100000:1.0:1787583133.659202:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583133.659231:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435879552:0@lo:400:kworker.0 00000100:00100000:1.0:1787583133.659252:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583133.659285:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435880064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787583133.659325:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583133.659387:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435879040 00000100:00100000:1.0:1787583133.659395:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435879040 00000100:00100000:1.0:1787583133.659446:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435879552 00000100:00100000:1.0:1787583133.659450:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435879552 00000100:00100000:1.0:1787583133.659473:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787583133.659482:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435879040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583133.659606:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435880064 00000100:00100000:3.0:1787583133.659610:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435880064 00000100:00100000:3.0:1787583133.659641:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787583133.659701:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435880064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787583133.659725:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583133.659765:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435880064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583133.659772:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787583133.659953:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435879040:12345-0@lo:400:kworker.0 Request processed in 471us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583133.659961:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787583133.659969:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787583133.659977:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435879552:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787583133.659983:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787583133.660007:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435879552:12345-0@lo:400:kworker.0 Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583133.660015:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435880064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583133.660025:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00080000:1.0:1787583133.660028:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc63b80 x1874416435879040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583133.660038:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435879040:0@lo:400:kworker.0 00010000:00080000:1.0:1787583133.660056:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fceaa00 x1874416435879552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583133.660064:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435879552:0@lo:400:kworker.0 00000100:00100000:2.0:1787583133.660196:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583133.660233:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435879168:0@lo:400:kworker.0 00000100:00100000:2.0:1787583133.660258:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583133.660282:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435879680:0@lo:400:kworker.0 00000100:00100000:2.0:1787583133.660316:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583133.660335:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435879168 00000100:00100000:3.0:1787583133.660339:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435879168 00000100:00100000:2.0:1787583133.660352:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435879680 00000100:00100000:2.0:1787583133.660355:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435879680 00000100:00100000:3.0:1787583133.660366:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787583133.660372:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435879168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583133.660396:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787583133.660402:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435879680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583133.660406:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435879168:12345-0@lo:400:kworker.0 Request processed in 35us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583133.660411:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787583133.660430:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435879680:12345-0@lo:400:kworker.0 Request processed in 29us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583133.660435:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1787583133.660443:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787583133.660457:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435879168:0@lo:400:kworker.0 00000100:00100000:2.0:1787583133.660466:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435879680:0@lo:400:kworker.0 00000100:00100000:1.0:1787583133.660781:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435878656 00000100:00100000:1.0:1787583133.660786:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435878656 00000100:00100000:1.0:1787583133.660832:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787583133.660839:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435878656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583133.661024:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435878656:12345-0@lo:400:kworker.0 Request processed in 185us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583133.661031:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787583133.661353:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435878656:0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.662003:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435878528 00000100:00100000:0.0:1787583133.662010:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435878528 00000100:00100000:0.0:1787583133.662058:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787583133.662067:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435878528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583133.662127:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435878528:12345-0@lo:400:kworker.0 Request processed in 62us (3105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583133.662133:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787583133.662489:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435878528:0@lo:400:kworker.0 00010000:00010000:1.0:1787583134.094194:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583134.158332:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435880192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787583134.158409:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583134.158722:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435880192 00000100:00100000:2.0:1787583134.158731:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435880192 00000100:00100000:2.0:1787583134.158780:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787583134.158790:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435880192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583134.158812:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583134.158904:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435880192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583134.158910:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787583134.158996:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435880192:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787583135.118307:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583136.143076:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583136.526226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583136.526263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583136.526309:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583136.526329:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583136.526347:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583136.526363:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583136.526395:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583136.526422:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413815424 00000100:00100000:3.0:1787583136.526431:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413815424 00000100:00100000:3.0:1787583136.526488:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413815936 00000100:00100000:3.0:1787583136.526491:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413815936 00000100:00100000:3.0:1787583136.526517:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413815296 00000100:00100000:3.0:1787583136.526520:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413815296 00000100:00100000:3.0:1787583136.526532:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413815808 00000100:00100000:3.0:1787583136.526534:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413815808 00000100:00100000:3.0:1787583136.526553:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 337 00000100:00100000:3.0:1787583136.526562:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413815424:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583136.526633:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413815424:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 72us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583136.526639:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 337 00000100:00100000:3.0:1787583136.526695:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 338 00000100:00100000:3.0:1787583136.526703:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413815936:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583136.526727:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413815936:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583136.526734:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 338 00000100:00100000:3.0:1787583136.526745:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 339 00000100:00100000:3.0:1787583136.526751:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:2406:x1874416413815296:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583136.526780:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:2406:x1874416413815296:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583136.526785:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 339 00000100:00100000:3.0:1787583136.526796:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 340 00000100:00100000:3.0:1787583136.526802:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+6:2406:x1874416413815808:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583136.526821:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+6:2406:x1874416413815808:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 20us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583136.526827:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 340 00000100:00100000:3.0:1787583136.526862:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413815680 00000100:00100000:3.0:1787583136.526871:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413815680 00000100:00100000:3.0:1787583136.526898:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413815552 00000100:00100000:3.0:1787583136.526901:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413815552 00000100:00100000:3.0:1787583136.526921:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:3.0:1787583136.526927:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413815680:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583136.526954:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2406:x1874416413815680:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583136.526960:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:3.0:1787583136.526970:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:3.0:1787583136.526975:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413815552:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583136.526997:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2406:x1874416413815552:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583136.527003:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00080000:3.0:1787583136.527031:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787583136.527035:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787583136.527037:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787583136.527040:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787583136.527129:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413815168 00000100:00100000:0.0:1787583136.527134:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413815168 00000100:00100000:0.0:1787583136.527171:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 391 00000100:00100000:0.0:1787583136.527178:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413815168:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583136.527203:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+13:2406:x1874416413815168:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583136.527215:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 391 00000001:02000400:1.0:1787583136.535570:0:14967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:52:14 (1787583134) 00000100:00100000:3.0:1787583136.717983:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787583136.718005:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435880320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583136.718070:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583136.718151:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435880320 00000100:00100000:2.0:1787583136.718159:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435880320 00000100:00100000:2.0:1787583136.718225:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787583136.718241:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435880320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787583136.718291:0:10212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787583136.718359:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435880320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583136.718368:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787583136.725133:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435880320:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1787583136.726428:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1787583136.726457:0:6506:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787583136.726514:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787583136.726525:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1787583136.727036:0:8437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:2.0:1787583137.175651:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583137.742016:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435880448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583137.742088:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583137.742726:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435880576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787583137.742759:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583137.743343:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435880448 00000100:00100000:2.0:1787583137.743352:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435880448 00000100:00100000:2.0:1787583137.743413:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435880576 00000100:00100000:2.0:1787583137.743417:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435880576 00000100:00100000:2.0:1787583137.743436:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787583137.743444:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435880448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787583137.743482:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:0.0:1787583137.743557:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787583137.745324:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435880448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1871us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583137.745336:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787583137.745365:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787583137.745377:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435880576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583137.745398:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787583137.745516:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435880576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583137.745522:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787583137.746026:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435880448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787583137.746490:0:3655:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1787583137.746496:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90937fc63480, transno 4294967325 00000100:00100000:0.0:1787583137.746526:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435880576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787583138.192188:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583138.766163:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435880704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787583138.766231:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583138.766296:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435880704 00000100:00100000:0.0:1787583138.766300:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435880832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583138.766303:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435880704 00000100:00100000:0.0:1787583138.766325:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583138.766348:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787583138.766358:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435880704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787583138.766388:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787583138.766394:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435880832 00000100:00100000:1.0:1787583138.766544:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435880832 00000100:00100000:1.0:1787583138.766582:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787583138.766589:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435880832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787583138.766607:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583138.766804:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435880960:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.766836:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583138.766892:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435881472:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.766916:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583138.766933:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435881984:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.766951:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583138.766967:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787583138.766971:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435881088:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767000:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583138.767015:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435881600:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767033:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583138.767046:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435882112:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767065:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583138.767087:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435881472 00000100:00100000:2.0:1787583138.767091:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435881472 00000100:00100000:2.0:1787583138.767112:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435881984 00000100:00100000:2.0:1787583138.767115:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435881984 00000100:00100000:2.0:1787583138.767126:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435881088 00000100:00100000:2.0:1787583138.767128:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435881088 00000100:00100000:2.0:1787583138.767137:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435881600 00000100:00100000:2.0:1787583138.767139:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435881600 00000100:00100000:2.0:1787583138.767148:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435882112 00000100:00100000:2.0:1787583138.767150:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435882112 00000100:00100000:2.0:1787583138.767161:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787583138.767168:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435881472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767201:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435881472:12345-0@lo:400:kworker.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583138.767207:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787583138.767223:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787583138.767228:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435881984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767252:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435881984:12345-0@lo:400:kworker.0 Request processed in 24us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583138.767270:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787583138.767280:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787583138.767284:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435881088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767320:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435881088:12345-0@lo:400:kworker.0 Request processed in 35us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583138.767326:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787583138.767336:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787583138.767342:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435881600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767364:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435881600:12345-0@lo:400:kworker.0 Request processed in 23us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583138.767370:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787583138.767379:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787583138.767385:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435882112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767424:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435882112:12345-0@lo:400:kworker.0 Request processed in 39us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583138.767431:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787583138.767480:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435881088:0@lo:400:kworker.0 00010000:00080000:2.0:1787583138.767492:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247f83480 x1874416435881600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583138.767502:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435881600:0@lo:400:kworker.0 00010000:00080000:2.0:1787583138.767511:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247f8ce00 x1874416435882112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583138.767519:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435882112:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767527:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435881472:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767535:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435881984:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767578:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435880960 00000100:00100000:2.0:1787583138.767582:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435880960 00000100:00100000:2.0:1787583138.767606:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787583138.767612:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435880960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767643:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435880960:12345-0@lo:400:kworker.0 Request processed in 31us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583138.767649:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787583138.767675:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435880960:0@lo:400:kworker.0 00000100:00080000:2.0:1787583138.767700:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583138.767704:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583138.767706:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787583138.767725:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435881216:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767748:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583138.767763:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435881728:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767781:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583138.767795:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435882240:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767811:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583138.767826:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787583138.767832:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435881344:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767868:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583138.767882:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435881856:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767900:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583138.767919:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435881344 00000100:00100000:2.0:1787583138.767922:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435881344 00000100:00100000:2.0:1787583138.767941:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787583138.767947:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435881344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.767981:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435881344:12345-0@lo:400:kworker.0 Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583138.767987:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787583138.768011:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435881344:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.768033:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435881728 00000100:00100000:2.0:1787583138.768036:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435881728 00000100:00100000:2.0:1787583138.768056:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435882240 00000100:00100000:2.0:1787583138.768058:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435882240 00000100:00100000:2.0:1787583138.768075:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435881856 00000100:00100000:2.0:1787583138.768078:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435881856 00000100:00100000:2.0:1787583138.768091:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787583138.768099:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435881728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583138.768107:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435880704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1748us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583138.768117:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787583138.768134:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435881216 00000100:00100000:2.0:1787583138.768139:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435881728:12345-0@lo:400:kworker.0 Request processed in 39us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583138.768140:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435881216 00000100:00100000:2.0:1787583138.768150:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787583138.768165:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787583138.768171:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787583138.768175:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435882240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583138.768182:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435881216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.768208:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435882240:12345-0@lo:400:kworker.0 Request processed in 35us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583138.768216:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787583138.768227:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435881216:12345-0@lo:400:kworker.0 Request processed in 47us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583138.768233:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787583138.768237:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787583138.768244:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435881856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.768287:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435881856:12345-0@lo:400:kworker.0 Request processed in 46us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583138.768294:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787583138.768318:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435881856:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.768334:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435881216:0@lo:400:kworker.0 00000100:00080000:3.0:1787583138.768341:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787583138.768346:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435881728:0@lo:400:kworker.0 00000100:00100000:2.0:1787583138.768356:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435882240:0@lo:400:kworker.0 00000100:00100000:1.0:1787583138.771175:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435880832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4577us (4839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583138.771189:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787583138.771668:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435880704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787583138.771687:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435880832:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787583139.214401:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583139.279393:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787583139.279429:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435882368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787583139.279500:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583139.279526:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435882368 00000100:00100000:1.0:1787583139.279535:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435882368 00000100:00100000:1.0:1787583139.279636:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787583139.279647:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435882368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787583139.279669:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583139.279712:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435882368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583139.280384:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435882368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583139.288166:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00010000:00010000:3.0:1787583140.238639:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583140.775492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583140.775677:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413816192 00000100:00100000:2.0:1787583140.775688:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413816192 00000100:00100000:2.0:1787583140.775762:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1787583140.775774:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+18:13192:x1874416413816192:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:2.0:1787583140.776057:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:13192:x1874416413816192:12345-192.168.203.11@tcp:35:umount.0 Request processed in 285us (575us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787583140.776065:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00080000:3.0:1787583140.776580:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787583140.782762:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583140.785763:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413816448 00000100:00100000:2.0:1787583140.785778:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413816448 00000100:00100000:2.0:1787583140.785877:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:2.0:1787583140.785888:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+19:13192:x1874416413816448:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:2.0:1787583140.786185:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:13192:x1874416413816448:12345-192.168.203.11@tcp:35:umount.0 Request processed in 298us (3431us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787583140.786193:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:2.0:1787583140.791994:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583140.793304:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413816704 00000100:00100000:1.0:1787583140.793318:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413816704 00000100:00100000:1.0:1787583140.793389:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1787583140.793401:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909373fa2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+20:13192:x1874416413816704:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:1.0:1787583140.795412:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909373fa2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:13192:x1874416413816704:12345-192.168.203.11@tcp:35:umount.0 Request processed in 2005us (3420us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787583140.795425:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1787583140.801516:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583140.801668:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413816960 00000100:00100000:0.0:1787583140.801687:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413816960 00000100:00100000:0.0:1787583140.801972:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1787583140.801984:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:13192:x1874416413816960:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:0.0:1787583140.802312:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:13192:x1874416413816960:12345-192.168.203.11@tcp:35:umount.0 Request processed in 329us (803us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787583140.802320:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:1.0:1787583140.816341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583140.816374:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583140.816406:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583140.816433:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413817088 00000100:00100000:1.0:1787583140.816442:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413817088 00000100:00100000:1.0:1787583140.816490:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413817344 00000100:00100000:1.0:1787583140.816503:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413817344 00000100:00100000:1.0:1787583140.816521:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413817216 00000100:00100000:1.0:1787583140.816523:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413817216 00000100:00100000:1.0:1787583140.816544:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1787583140.816560:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa77711a-a697-4098-9892-32db59b6905c+15:2405:x1874416413817088:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583140.816587:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583140.816603:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924770be00/0x19a47956376b6216 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4096 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583140.816618:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583140.816661:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa77711a-a697-4098-9892-32db59b6905c+14:2405:x1874416413817088:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 109us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583140.816668:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1787583140.816684:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1787583140.816690:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa77711a-a697-4098-9892-32db59b6905c+13:2405:x1874416413817344:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583140.816707:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583140.816716:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713f800/0x19a47956376b6431 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c416f expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583140.816724:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583140.816741:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa77711a-a697-4098-9892-32db59b6905c+12:2405:x1874416413817344:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 51us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583140.816747:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1787583140.816759:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1787583140.816765:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa77711a-a697-4098-9892-32db59b6905c+11:2405:x1874416413817216:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583140.816772:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583140.816781:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909340031200/0x19a47956376b6159 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4057 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583140.816790:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583140.816807:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa77711a-a697-4098-9892-32db59b6905c+10:2405:x1874416413817216:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 42us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583140.816820:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1787583140.817562:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583140.817656:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413817472 00000100:00100000:3.0:1787583140.817663:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413817472 00000100:00100000:3.0:1787583140.817726:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:3.0:1787583140.817735:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2403:x1874416413817472:12345-192.168.203.11@tcp:9:umount.0 00000020:00000080:3.0:1787583140.817758:0:8442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6534 00000100:00080000:3.0:1787583140.817766:0:8442:0:(import.c:65:import_set_state_nolock()) ffff9093453a2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787583140.817808:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787583140.817963:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+2:2403:x1874416413817472:12345-192.168.203.11@tcp:9:umount.0 Request processed in 229us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583140.817984:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00010000:00010000:2.0:1787583140.818217:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787583140.818226:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787583140.831994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583140.832093:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413817856 00000100:00100000:2.0:1787583140.832104:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413817856 00000100:00100000:2.0:1787583140.832176:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:2.0:1787583140.832186:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+7:2403:x1874416413817856:12345-192.168.203.11@tcp:9:umount.0 00000020:00000080:2.0:1787583140.832234:0:8445:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b67a3 00000020:00010000:2.0:1787583140.832255:0:8445:0:(genops.c:1921:obd_stale_export_put()) Put export ffff909247e55000: total 0 00000100:00080000:2.0:1787583140.832259:0:8445:0:(import.c:65:import_set_state_nolock()) ffff909247e51800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787583140.832313:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787583140.832466:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2403:x1874416413817856:12345-192.168.203.11@tcp:9:umount.0 Request processed in 280us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583140.832474:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00000020:00010000:1.0:1787583140.832861:0:7469:0:(genops.c:1907:obd_stale_export_get()) Get export ffff909247e55000: total 0 00010000:00010000:1.0:1787583140.832899:0:7469:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff909247e55000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787583140.832948:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002968e2a/0x19a47956376b6b62 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4359 expref: 4 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583140.832982:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000483b63b4/0x19a47956376b7231 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c453c expref: 3 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583140.832997:0:7469:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff909247e55000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787583140.833009:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583140.833011:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583140.833013:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787583140.833152:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583140.848757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583140.848942:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413818880 00000100:00100000:2.0:1787583140.848952:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413818880 00000100:00100000:2.0:1787583140.849018:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 258 00000100:00100000:2.0:1787583140.849029:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+22:2403:x1874416413818880:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:2.0:1787583140.849075:0:7748:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6167 00000020:00010000:2.0:1787583140.849092:0:7748:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90937fb94000: total 0 00000100:00080000:2.0:1787583140.849096:0:7748:0:(import.c:65:import_set_state_nolock()) ffff90937fb97800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787583140.849129:0:7748:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1787583140.849298:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+21:2403:x1874416413818880:12345-192.168.203.11@tcp:39:umount.0 Request processed in 271us (549us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1787583140.849306:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 258 00000020:00010000:0.0:1787583140.849472:0:10405:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90937fb94000: total 0 00010000:00010000:0.0:1787583140.849528:0:10405:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90937fb94000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787583140.849574:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90937e015600) 00010000:00010000:0.0:1787583140.849578:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583140.849585:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b6493 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c417d expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849609:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:0.0:1787583140.849612:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787583140.849616:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53600/0x19a47956376b6be7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c437c expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849630:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583140.849632:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787583140.849636:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497400/0x19a47956376b71f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4527 expref: 18 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849649:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:0.0:1787583140.849651:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787583140.849655:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c52000/0x19a47956376b6a43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c430c expref: 17 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849668:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90937e3be800) 00010000:00010000:0.0:1787583140.849671:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787583140.849674:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53000/0x19a47956376b6ed4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4455 expref: 16 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849691:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013400) 00010000:00010000:0.0:1787583140.849694:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583140.849713:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b6bcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4375 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849727:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583140.849729:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787583140.849733:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909247c53e00/0x19a47956376b721c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4535 expref: 14 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849745:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583140.849747:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787583140.849750:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e400/0x19a47956376b650a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4199 expref: 13 pid: 13828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849761:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:0.0:1787583140.849764:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787583140.849767:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e000/0x19a47956376b6b23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4344 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849777:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff909342920a00) 00010000:00010000:0.0:1787583140.849780:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787583140.849783:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f000/0x19a47956376b6b4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4352 expref: 11 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849797:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90937e015500) 00010000:00010000:0.0:1787583140.849799:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583140.849803:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713e200/0x19a47956376b64af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4184 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849815:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90937e013000) 00010000:00010000:0.0:1787583140.849822:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787583140.849826:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909248497a00/0x19a47956376b7112 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c44ef expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849895:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff909345181100) 00010000:00010000:0.0:1787583140.849899:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787583140.849903:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909341480000/0x19a47956376b6805 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4272 expref: 8 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583140.849917:0:10405:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90937fb94000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787583140.849932:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583140.849934:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583140.849936:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583140.863507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583140.863825:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413819008 00000100:00100000:3.0:1787583140.863835:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413819008 00000100:00100000:3.0:1787583140.863939:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 259 00000100:00100000:3.0:1787583140.863949:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+5:2403:x1874416413819008:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:3.0:1787583140.863980:0:6527:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b616e 00000100:00080000:3.0:1787583140.863996:0:6527:0:(import.c:65:import_set_state_nolock()) ffff90936f233000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787583140.864026:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1787583140.864232:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787583140.864321:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787583140.864495:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c54c7da2-d1ec-4db9-98d7-e170a1f2cfae+3:2403:x1874416413819008:12345-192.168.203.11@tcp:39:umount.0 Request processed in 545us (995us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787583140.864504:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 259 00010000:00010000:2.0:1787583141.262838:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583141.648129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583141.648183:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583141.648209:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583141.648299:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413819136 00000100:00100000:3.0:1787583141.648308:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413819136 00000100:00100000:3.0:1787583141.648377:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 393 00000100:00100000:3.0:1787583141.648387:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:2406:x1874416413819136:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583141.648451:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa77711a-a697-4098-9892-32db59b6905c+10:2406:x1874416413819136:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583141.648457:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 393 00000100:00100000:0.0:1787583141.648715:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413819264 00000100:00100000:0.0:1787583141.648720:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413819264 00000100:00100000:0.0:1787583141.648764:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413819392 00000100:00100000:0.0:1787583141.648767:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413819392 00000100:00100000:0.0:1787583141.648790:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 347 00000100:00100000:0.0:1787583141.648798:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+6:2406:x1874416413819264:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583141.648829:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+6:2406:x1874416413819264:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583141.648835:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 347 00000100:00100000:0.0:1787583141.648881:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 348 00000100:00100000:0.0:1787583141.648888:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413819392:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583141.648911:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b124cdab-8363-4433-96a8-2d8722f1634b+5:2406:x1874416413819392:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583141.648917:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 348 00000100:00080000:3.0:1787583141.649076:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787583141.649080:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787583141.839684:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435882496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787583141.839756:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583141.839884:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435882496 00000100:00100000:3.0:1787583141.839893:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435882496 00000100:00100000:3.0:1787583141.839945:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787583141.839955:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435882496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787583141.840014:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787583141.840064:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435882496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583141.840071:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787583141.840114:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435882496:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787583142.286038:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583142.862303:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435882624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583142.862371:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583142.862634:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435882624 00000100:00100000:0.0:1787583142.862643:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435882624 00000100:00100000:0.0:1787583142.862705:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787583142.862716:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435882624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787583142.862742:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787583142.862785:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435882624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583142.862792:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1787583142.862880:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583142.862965:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435882624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583142.863330:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435882752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583142.863363:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583142.863546:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435882752 00000100:00100000:0.0:1787583142.863552:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435882752 00000100:00100000:0.0:1787583142.863594:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787583142.863601:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435882752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583142.863613:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787583142.863655:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435882752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583142.863662:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1787583142.863747:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787583142.863883:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435882752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583142.892927:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583142.892985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583142.893019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583142.893128:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413819520 00000100:00100000:3.0:1787583142.893138:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413819520 00000100:00100000:3.0:1787583142.893195:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413819776 00000100:00100000:3.0:1787583142.893198:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413819776 00000100:00100000:3.0:1787583142.893216:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413819648 00000100:00100000:3.0:1787583142.893219:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413819648 00000100:00100000:3.0:1787583142.893248:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1787583142.893257:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aa77711a-a697-4098-9892-32db59b6905c+12:2406:x1874416413819520:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583142.893270:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583142.893287:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713fe00/0x19a47956376b626a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40ab expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583142.893304:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583142.893348:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aa77711a-a697-4098-9892-32db59b6905c+11:2406:x1874416413819520:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 93us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583142.893355:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1787583142.893371:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:3.0:1787583142.893387:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093770b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aa77711a-a697-4098-9892-32db59b6905c+10:2406:x1874416413819776:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583142.893411:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583142.893421:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924770b400/0x19a47956376b642a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4168 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583142.893430:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583142.893448:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093770b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aa77711a-a697-4098-9892-32db59b6905c+9:2406:x1874416413819776:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 63us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583142.893455:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:3.0:1787583142.893490:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:3.0:1787583142.893497:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aa77711a-a697-4098-9892-32db59b6905c+8:2406:x1874416413819648:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583142.893504:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583142.893512:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367ea00/0x19a47956376b6271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c40dc expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583142.893520:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583142.893537:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aa77711a-a697-4098-9892-32db59b6905c+7:2406:x1874416413819648:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 40us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583142.893543:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1787583142.908550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583142.908644:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413820032 00000100:00100000:3.0:1787583142.908654:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413820032 00000100:00100000:3.0:1787583142.908714:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 260 00000100:00100000:3.0:1787583142.908723:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+6:2403:x1874416413820032:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:3.0:1787583142.908761:0:6527:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b627f 00000020:00010000:3.0:1787583142.908769:0:6527:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90937fc02800: total 0 00000100:00080000:3.0:1787583142.908773:0:6527:0:(import.c:65:import_set_state_nolock()) ffff90937fc00000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787583142.908806:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:1.0:1787583142.909529:0:10405:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90937fc02800: total 0 00010000:00010000:1.0:1787583142.909579:0:10405:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90937fc02800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787583142.909610:0:10405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90937e013400) 00010000:00010000:1.0:1787583142.909613:0:10405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787583142.909621:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deda00/0x19a47956376b723f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4543 expref: 7 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583142.909640:0:10405:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90937fc02800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787583142.909648:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583142.909650:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583142.909652:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583142.910916:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b124cdab-8363-4433-96a8-2d8722f1634b+3:2403:x1874416413820032:12345-192.168.203.11@tcp:39:umount.0 Request processed in 2187us (2368us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1787583142.910944:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 260 00000001:00080000:2.0:1787583142.925957:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000001:00100000:2.0:1787583142.925969:0:6506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000001:00080000:2.0:1787583142.925974:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1787583142.926001:0:6506:0:(genops.c:885:class_export_put()) final put ffff90937fb94000/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000020:00000080:1.0:1787583142.926150:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90937fb94000/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae for lustre-MDT0000 00000020:00000080:1.0:1787583142.926218:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90937fb97800 for lustre-MDT0000 00000100:00100000:1.0:1787583142.935731:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583142.935819:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413820160 00000100:00100000:0.0:1787583142.935829:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413820160 00000100:00100000:0.0:1787583142.935914:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 261 00000100:00100000:0.0:1787583142.935925:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+5:2403:x1874416413820160:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:0.0:1787583142.936117:0:6528:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6286 00000100:00080000:0.0:1787583142.936129:0:6528:0:(import.c:65:import_set_state_nolock()) ffff90937fb90800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787583142.936155:0:6528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787583142.936328:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b124cdab-8363-4433-96a8-2d8722f1634b+3:2403:x1874416413820160:12345-192.168.203.11@tcp:39:umount.0 Request processed in 403us (605us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787583142.936355:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 261 00010000:00010000:1.0:1787583142.936513:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583142.983072:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583142.983202:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413820416 00000100:00100000:2.0:1787583142.983212:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413820416 00000100:00100000:2.0:1787583142.983280:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 394 00000100:00100000:2.0:1787583142.983290:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+7:2403:x1874416413820416:12345-192.168.203.11@tcp:251:umount.0 00000020:00000080:2.0:1787583142.983336:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6144 00000020:00010000:2.0:1787583142.983344:0:6521:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90936f2d3800: total 0 00000100:00080000:2.0:1787583142.983348:0:6521:0:(import.c:65:import_set_state_nolock()) ffff90936f2d2800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787583142.983433:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa77711a-a697-4098-9892-32db59b6905c+3:2403:x1874416413820416:12345-192.168.203.11@tcp:251:umount.0 Request processed in 143us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583142.983441:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 394 00000020:00010000:0.0:1787583142.983548:0:6515:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90936f2d3800: total 0 00010000:00010000:0.0:1787583142.983553:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583142.983599:0:6515:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90936f2d3800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787583142.983629:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344ded000/0x19a47956376b621d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c409d expref: 2 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583142.983643:0:6515:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90936f2d3800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787583142.983653:0:6515:0:(genops.c:885:class_export_put()) final put ffff90936f2d3800/aa77711a-a697-4098-9892-32db59b6905c 00010000:00010000:0.0:1787583142.983674:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583142.983676:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583142.983678:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787583142.983973:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f2d3800/aa77711a-a697-4098-9892-32db59b6905c for MGS 00000020:00000080:2.0:1787583142.984008:0:15041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936f2d2800 for MGS 00010000:00010000:1.0:1787583143.314079:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787583143.758781:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787583143.758799:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787583143.758927:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787583143.758935:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787583143.759571:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787583143.898622:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435882880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583143.898701:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583143.898799:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435882880 00000100:00100000:2.0:1787583143.898806:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435882880 00000100:00100000:2.0:1787583143.898871:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787583143.898881:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435882880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787583143.898913:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787583143.898961:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435882880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583143.898968:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787583143.899021:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435882880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787583143.900000:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435883136:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.900166:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583143.900197:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435883648:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.900216:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583143.900243:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435884160:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.900261:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583143.900278:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787583143.900283:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435883008:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.900413:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583143.900504:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435883520:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.900539:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583143.900557:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435884032:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.900576:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583143.900602:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435883136 00000100:00100000:0.0:1787583143.900608:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435883136 00000100:00100000:0.0:1787583143.900638:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435883648 00000100:00100000:0.0:1787583143.900641:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435883648 00000100:00100000:0.0:1787583143.901131:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435884160 00000100:00100000:0.0:1787583143.901136:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435884160 00000100:00100000:0.0:1787583143.901148:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435883520 00000100:00100000:0.0:1787583143.901149:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435883520 00000100:00100000:0.0:1787583143.901159:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435884032 00000100:00100000:0.0:1787583143.901161:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435884032 00000100:00100000:0.0:1787583143.901176:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787583143.901184:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435883136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.901248:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435883136:12345-0@lo:400:kworker.0 Request processed in 65us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583143.901256:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787583143.901277:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787583143.901284:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435883648:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787583143.901890:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583143.901895:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787583143.902058:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435883648:12345-0@lo:400:kworker.0 Request processed in 773us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583143.902065:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787583143.902083:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787583143.902090:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435884160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902118:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874416435884160:12345-0@lo:400:kworker.0 Request processed in 30us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583143.902135:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787583143.902152:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787583143.902160:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435883520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902189:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435883520:12345-0@lo:400:kworker.0 Request processed in 32us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583143.902195:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787583143.902206:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787583143.902212:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435884032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902252:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874416435884032:12345-0@lo:400:kworker.0 Request processed in 40us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583143.902259:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787583143.902287:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435883008 00000100:00100000:0.0:1787583143.902292:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435883008 00000100:00100000:0.0:1787583143.902330:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1787583143.902338:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3654:x1874416435883008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902371:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3654:x1874416435883008:12345-0@lo:400:kworker.0 Request processed in 35us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583143.902377:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1787583143.902445:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435883008:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902460:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435883520:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902469:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874416435884032:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902480:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435883136:0@lo:400:kworker.0 00010000:00080000:0.0:1787583143.902492:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc61880 x1874416435883648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583143.902511:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435883648:0@lo:400:kworker.0 00010000:00080000:0.0:1787583143.902524:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc62a00 x1874416435884160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583143.902534:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435884160:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902577:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435883264:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902607:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583143.902627:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435883776:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902664:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583143.902692:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435884288:0@lo:400:kworker.0 00000100:00100000:2.0:1787583143.902709:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435883776 00000100:00100000:0.0:1787583143.902716:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583143.902719:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435883776 00000100:00100000:0.0:1787583143.902744:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787583143.902747:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435884288 00000100:00100000:2.0:1787583143.902750:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435884288 00000100:00100000:0.0:1787583143.902754:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435883392:0@lo:400:kworker.0 00000100:00100000:2.0:1787583143.902769:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787583143.902776:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435883776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902782:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583143.902812:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435883776:12345-0@lo:400:kworker.0 Request processed in 38us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583143.902818:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787583143.902822:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435883904:0@lo:400:kworker.0 00000100:00100000:2.0:1787583143.902830:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787583143.902835:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435884288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902873:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583143.902886:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435884288:12345-0@lo:400:kworker.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583143.902891:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787583143.902895:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435884416:0@lo:400:kworker.0 00000100:00100000:2.0:1787583143.902899:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435883904 00000100:00100000:2.0:1787583143.902902:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435883904 00000100:00100000:2.0:1787583143.902914:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787583143.902919:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435883904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.902927:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583143.902956:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435883904:12345-0@lo:400:kworker.0 Request processed in 36us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583143.902956:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435883776:0@lo:400:kworker.0 00000100:00100000:2.0:1787583143.902967:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787583143.902975:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435884416 00000100:00100000:2.0:1787583143.902977:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435884416 00000100:00100000:0.0:1787583143.902978:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435884288:0@lo:400:kworker.0 00000100:00100000:2.0:1787583143.902991:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787583143.902997:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435884416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.903005:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435883904:0@lo:400:kworker.0 00000100:00100000:2.0:1787583143.903021:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435884416:12345-0@lo:400:kworker.0 Request processed in 25us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583143.903026:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787583143.903029:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435884416:0@lo:400:kworker.0 00000100:00080000:2.0:1787583143.903047:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583143.903063:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435883264 00000100:00100000:0.0:1787583143.903068:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435883264 00000100:00100000:0.0:1787583143.903094:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787583143.903101:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435883264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.903141:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435883264:12345-0@lo:400:kworker.0 Request processed in 40us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583143.903148:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787583143.903173:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435883392 00000100:00100000:0.0:1787583143.903177:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435883392 00000100:00100000:0.0:1787583143.903208:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787583143.903215:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435883392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.903255:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435883392:12345-0@lo:400:kworker.0 Request processed in 41us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583143.903262:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787583143.903290:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435883392:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.903299:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435883264:0@lo:400:kworker.0 00000100:00100000:0.0:1787583143.904631:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787583143.904647:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435884544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787583143.904703:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583143.906182:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435884544 00000100:00100000:3.0:1787583143.906193:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435884544 00000100:00100000:3.0:1787583143.906261:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787583143.906272:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435884544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787583143.906302:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583143.906366:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435884544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583143.906375:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787583143.907100:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435884544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787583144.335482:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583144.398863:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787583144.398895:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435884672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787583144.398964:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583144.399175:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435884672 00000100:00100000:1.0:1787583144.399185:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435884672 00000100:00100000:1.0:1787583144.399253:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787583144.399264:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435884672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787583144.399293:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787583144.399361:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435884672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583144.399370:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787583144.399418:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435884672:0@lo:13:osp-pre-1-1.0 00000020:01000004:1.0:1787583144.850403:0:15164:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787583144.879059:0:15164:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787583144.879113:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.879128:0:15164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.879135:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.879143:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.879166:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787583144.879171:0:15164:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787583144.879194:0:15164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787583144.879198:0:15164:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787583144.879204:0:15164:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787583144.879238:0:15164:0:(import.c:65:import_set_state_nolock()) ffff909365f94800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787583144.879269:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874416435884800:0@lo:39:umount.0 00000100:00100000:2.0:1787583144.879330:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583144.879599:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435884800 00000100:00100000:0.0:1787583144.879607:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435884800 00000100:00100000:0.0:1787583144.879661:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787583144.879670:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874416435884800:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787583144.879695:0:6527:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5d5b 00000100:00080000:0.0:1787583144.879718:0:6527:0:(import.c:65:import_set_state_nolock()) ffff909365f93800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787583144.879777:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3652:x1874416435884800:12345-0@lo:39:umount.0 Request processed in 107us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583144.879785:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1787583144.879793:0:6527:0:(genops.c:885:class_export_put()) final put ffff909377ef0800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1787583144.879820:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583144.879826:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.879834:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583144.879837:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.879868:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583144.879877:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583144.879883:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787583144.879886:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787583144.879888:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787583144.879924:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.879931:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787583144.879947:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.879954:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924770a200/0x19a47956376b61ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b61f3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.879977:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583144.879979:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583144.879981:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583144.879993:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435884928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583144.880022:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787583144.880078:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909365f94800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787583144.880086:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874416435884800:0@lo:39:umount.0 00000020:00000080:3.0:1787583144.880262:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff909377ef0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787583144.880314:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff909365f93800 for lustre-MDT0000 00000100:00100000:3.0:1787583144.880329:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435884928 00000100:00100000:3.0:1787583144.880333:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435884928 00000100:00100000:3.0:1787583144.880415:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787583144.880423:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3655:x1874416435884928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787583144.880433:0:13742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583144.880448:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713f200/0x19a47956376b61f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b61ec expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583144.880460:0:13742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583144.880493:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5bddce63-0a65-4d1b-a395-d8312cc42532+23:3655:x1874416435884928:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (470us total) trans 0 rc 0/0 00010000:00010000:1.0:1787583144.881039:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787583144.885662:0:15164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787583144.885671:0:15164:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787583144.885678:0:15164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1787583144.887554:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787583144.887665:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435884928:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787583144.891886:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892133:0:15164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892154:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892162:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892186:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787583144.892193:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892201:0:15164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892208:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892226:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892239:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787583144.892245:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892252:0:15164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892259:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892276:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892297:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787583144.892303:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480800/0x19a47956376b5cba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892311:0:15164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480800/0x19a47956376b5cba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892318:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909341480800/0x19a47956376b5cba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892325:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff909341480800/0x19a47956376b5cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583144.892335:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787583144.892338:0:15164:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787583144.892365:0:15164:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787583144.892370:0:15164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787583144.892374:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787583144.892380:0:15164:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00010000:00010000:0.0:1787583144.892687:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787583144.892696:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.892703:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770ac00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583144.892707:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.892716:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583144.892724:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583144.892731:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787583144.892733:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1787583144.892735:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1787583144.892773:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.892780:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787583144.892809:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.892816:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924770ac00/0x19a47956376b61fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b6201 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.892831:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787583144.892834:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.892841:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583144.892869:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.892877:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583144.892883:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583144.892889:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787583144.892891:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787583144.892894:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:2.0:1787583144.893164:0:15164:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90936f237000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787583144.893171:0:15164:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff909245b02800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787583144.893176:0:15164:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90936ee0e000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787583144.893182:0:15164:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90936db2c800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1787583144.893190:0:15164:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff90937fc02800 b124cdab-8363-4433-96a8-2d8722f1634b 192.168.203.11@tcp 1 (0 1 0) 1 0 0 0: 0000000000000000 4294967528 stale:0 00000020:00080000:2.0:1787583144.893201:0:15164:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff909365f1cd28) has exports, disconnecting them 00000020:00080000:2.0:1787583144.893206:0:15164:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90936f237000), last request at 1787583143 00000020:00000080:2.0:1787583144.893224:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6072 00000100:00080000:2.0:1787583144.893242:0:15164:0:(import.c:65:import_set_state_nolock()) ffff90936f232000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787583144.893291:0:15164:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90936f237000): rc 0 00000020:00000080:2.0:1787583144.893293:0:15164:0:(genops.c:885:class_export_put()) final put ffff90936f237000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787583144.893304:0:15164:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff909245b02800), last request at 1787583143 00000020:00000080:2.0:1787583144.893307:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5f45 00000100:00080000:2.0:1787583144.893313:0:15164:0:(import.c:65:import_set_state_nolock()) ffff909245b01000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787583144.893319:0:15164:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff909245b02800): rc 0 00000020:00000080:2.0:1787583144.893321:0:15164:0:(genops.c:885:class_export_put()) final put ffff909245b02800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787583144.893326:0:15164:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90936ee0e000), last request at 1787582916 00000020:00000080:2.0:1787583144.893328:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5e42 00000100:00080000:2.0:1787583144.893331:0:15164:0:(import.c:65:import_set_state_nolock()) ffff90936ee08000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787583144.893337:0:15164:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90936ee0e000): rc 0 00000020:00000080:2.0:1787583144.893339:0:15164:0:(genops.c:885:class_export_put()) final put ffff90936ee0e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787583144.893343:0:15164:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90936db2c800), last request at 1787582916 00000020:00000080:2.0:1787583144.893346:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5e03 00000100:00080000:2.0:1787583144.893349:0:15164:0:(import.c:65:import_set_state_nolock()) ffff90936d8a0800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787583144.893430:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.893438:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787583144.893457:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.893464:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909341480400/0x19a47956376b60fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b6105 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.893485:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787583144.893489:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.893495:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583144.893499:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.893506:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583144.893513:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583144.893519:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787583144.893522:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787583144.893524:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787583144.893884:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.893892:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000001:00000004:2.0:1787583144.894040:0:15164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1787583144.894120:0:15164:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90936db2c800): rc 0 00000004:00000080:2.0:1787583144.894126:0:15164:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa3cd41c37ae0 00000100:00080000:2.0:1787583144.894144:0:15164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787583144.894148:0:15164:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1787583144.895168:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.895186:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924770b200/0x19a47956376b6462 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b6469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.895204:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583144.895209:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909341480800/0x19a47956376b5cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.895243:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909341480800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583144.895247:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909341480800/0x19a47956376b5cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.895254:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909341480800/0x19a47956376b5cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583144.895260:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909341480800/0x19a47956376b5cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583144.895266:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787583144.895269:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787583144.895271:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787583144.895290:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583144.895301:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909341480800/0x19a47956376b5cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.895306:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787583144.895317:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909341480800/0x19a47956376b5cba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.895322:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909341480800/0x19a47956376b5cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b5cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.895332:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583144.895333:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583144.895335:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583144.895351:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435885056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787583144.895372:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435885440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583144.895763:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787583144.895831:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f237000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787583144.895889:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff909245b02800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787583144.896036:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff90936ee0e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787583144.896057:0:15041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936f232000 for lustre-MDT0000 00000020:00000080:0.0:1787583144.896062:0:15041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff909245b01000 for lustre-MDT0000 00000020:00000080:0.0:1787583144.896064:0:15041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936ee08000 for lustre-MDT0000 00000100:00100000:0.0:1787583144.896077:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435885184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583144.896105:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583144.896129:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583144.896136:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435885312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583144.896155:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583144.896233:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435885056 00000100:00100000:0.0:1787583144.896241:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435885056 00010000:00010000:1.0:1787583144.896281:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583144.896281:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435885184 00000100:00100000:0.0:1787583144.896284:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435885184 00010000:00010000:1.0:1787583144.896287:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583144.896300:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435885312 00000100:00100000:0.0:1787583144.896303:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435885312 00000100:00100000:0.0:1787583144.896316:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787583144.896560:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+25:3656:x1874416435885056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787583144.896574:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583144.896589:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909340031800/0x19a47956376b6201 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b61fa expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583144.896602:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583144.896640:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3656:x1874416435885056:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583144.896694:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787583144.897169:0:15164:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787583144.897190:0:15164:0:(import.c:65:import_set_state_nolock()) ffff90936d94d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787583144.897355:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787583144.897366:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+24:3653:x1874416435885184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583144.897375:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583144.897386:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90938216e400/0x19a47956376b6105 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b60fe expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583144.897396:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583144.897432:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:3653:x1874416435885184:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583144.897439:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787583144.897456:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435885440 00000100:00100000:1.0:1787583144.897460:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435885440 00000100:00100000:1.0:1787583144.897480:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787583144.897485:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+23:3653:x1874416435885312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583144.897493:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583144.897502:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713ee00/0x19a47956376b6469 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b6462 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583144.897510:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583144.897531:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+22:3653:x1874416435885312:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583144.897537:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787583144.897549:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787583144.897555:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+21:3655:x1874416435885440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583144.897563:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583144.897570:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909340030e00/0x19a47956376b5cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b5cba expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583144.897591:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583144.899197:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787583144.899291:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:3656:1874416435885056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583144.899326:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435885568:0@lo:39:umount.0 00000100:00100000:0.0:1787583144.899547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583144.899604:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435885312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583144.899612:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435885184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583144.899633:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435885568 00000100:00100000:0.0:1787583144.899638:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435885568 00000100:00100000:0.0:1787583144.899673:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787583144.899681:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936a142c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874416435885568:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787583144.899720:0:6532:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5e9d 00000100:00080000:0.0:1787583144.899727:0:6532:0:(import.c:65:import_set_state_nolock()) ffff90936d8cf800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787583144.904324:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3655:x1874416435885440:12345-0@lo:103:ldlm_bl.0 Request processed in 6760us (7621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583144.904338:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787583144.904368:0:15164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787583144.904389:0:15164:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1787583144.904406:0:15164:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787583144.904475:0:15164:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787583144.904510:0:15164:0:(import.c:65:import_set_state_nolock()) ffff90936d8a3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787583144.904524:0:15164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787583144.904526:0:15164:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1787583144.904532:0:15164:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787583144.904592:0:15164:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787583144.904600:0:15164:0:(import.c:65:import_set_state_nolock()) ffff90936f2d3000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787583144.904625:0:15164:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff909365f1cd28) has no exports 00000100:00100000:2.0:1787583144.904909:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435885696:0@lo:9:umount.0 00000100:00100000:3.0:1787583144.904953:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435885440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787583144.905187:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787583144.905207:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787583144.905485:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583144.905628:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936a142c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3652:x1874416435885568:12345-0@lo:39:umount.0 Request processed in 5946us (6080us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787583144.905637:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787583144.905767:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435885824:0@lo:9:umount.0 00000100:00100000:2.0:1787583144.905791:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787583144.905818:0:3652:0:(import.c:65:import_set_state_nolock()) ffff90936d94d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787583144.905823:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435885568:0@lo:39:umount.0 00000100:00100000:3.0:1787583144.906113:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435885824 00000100:00100000:3.0:1787583144.906120:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435885824 00000100:00100000:3.0:1787583144.906170:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787583144.906183:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874416435885824:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787583144.906206:0:8442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b612f 00000100:00080000:3.0:1787583144.906229:0:8442:0:(import.c:65:import_set_state_nolock()) ffff90936f2d4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787583144.906268:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787583144.906357:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3652:x1874416435885824:12345-0@lo:9:umount.0 Request processed in 175us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583144.906363:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1787583144.906527:0:3652:0:(import.c:65:import_set_state_nolock()) ffff90936f2d3000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787583144.906537:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787583144.906538:0:3652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787583144.906542:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435885824:0@lo:9:umount.0 00000100:00100000:2.0:1787583144.910607:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435885696 00000100:00100000:2.0:1787583144.910625:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435885696 00000100:00100000:2.0:1787583144.911027:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787583144.911038:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874416435885696:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787583144.911069:0:8445:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5fed 00000100:00080000:2.0:1787583144.911077:0:8445:0:(import.c:65:import_set_state_nolock()) ffff90936f0b4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787583144.911120:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:3.0:1787583144.911260:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787583144.911282:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583144.911285:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3652:x1874416435885696:12345-0@lo:9:umount.0 Request processed in 248us (5799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583144.911292:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1787583144.911322:0:3652:0:(import.c:65:import_set_state_nolock()) ffff90936d8a3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787583144.911341:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787583144.911344:0:3652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787583144.911348:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435885696:0@lo:9:umount.0 00010000:00010000:0.0:1787583144.911797:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787583144.935368:0:15164:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff909365f1cd28) has no exports 00000020:00000080:3.0:1787583145.001165:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5d15 00000020:00000080:3.0:1787583145.001180:0:15164:0:(genops.c:885:class_export_put()) final put ffff90937462e000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787583145.001260:0:15164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787583145.001637:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787583145.001648:0:15164:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787583145.001653:0:15164:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff909377ee4d28) has no exports 00000020:00000080:0.0:1787583145.002364:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5d0e 00000020:00000080:0.0:1787583145.002372:0:15164:0:(genops.c:885:class_export_put()) final put ffff909377ef5000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787583145.002894:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90937462e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787583145.003184:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff909377ef5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787583145.003267:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787583145.003345:0:15164:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787583145.003350:0:15164:0:(genops.c:885:class_export_put()) final put ffff90937462f800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787583145.003353:0:15164:0:(genops.c:844:class_export_destroy()) destroying export ffff90937462f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787583145.003360:0:15164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1787583145.358602:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583146.382987:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583146.958060:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787583146.958083:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435885952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583146.958152:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583146.958785:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435885952 00000100:00100000:0.0:1787583146.958794:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435885952 00000100:00100000:0.0:1787583146.958837:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787583146.958874:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3655:x1874416435885952:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1787583146.958890:0:6533:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787583146.958948:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3655:x1874416435885952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (795us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787583146.958955:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:02020000:1.0:1787583146.959268:0:3655:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:0.0:1787583146.973832:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787583146.973841:0:9523:0:(genops.c:885:class_export_put()) final put ffff90936f2d4000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787583146.973879:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000020:00000080:0.0:1787583146.973882:0:9523:0:(genops.c:885:class_export_put()) final put ffff9093453a3800/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000020:00000080:2.0:1787583146.974020:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f2d4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787583146.974066:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9093453a3800/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae for lustre-OST0001 00000020:00000080:2.0:1787583146.974090:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936f2d4800 for lustre-OST0001 00000020:00000080:2.0:1787583146.974094:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9093453a2000 for lustre-OST0001 00000001:00100000:0.0:1787583146.974160:0:7459:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787583146.974170:0:7459:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1787583146.974174:0:7459:0:(genops.c:885:class_export_put()) final put ffff90936d8cd000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787583146.974189:0:7459:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b124cdab-8363-4433-96a8-2d8722f1634b 00000001:00080000:0.0:1787583146.974194:0:7459:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1787583146.974196:0:7459:0:(genops.c:885:class_export_put()) final put ffff90937fb92000/b124cdab-8363-4433-96a8-2d8722f1634b 00000001:00100000:0.0:1787583146.974211:0:7459:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000001:00080000:0.0:1787583146.974215:0:7459:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1787583146.974217:0:7459:0:(genops.c:885:class_export_put()) final put ffff90936f233800/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000020:00000080:2.0:1787583146.974264:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936d8cd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787583146.974294:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90937fb92000/b124cdab-8363-4433-96a8-2d8722f1634b for lustre-MDT0001 00000020:00000080:2.0:1787583146.974326:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f233800/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae for lustre-MDT0001 00000020:00000080:2.0:1787583146.974351:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936d8cf800 for lustre-MDT0001 00000020:00000080:2.0:1787583146.974355:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90937fb90800 for lustre-MDT0001 00000020:00000080:2.0:1787583146.974358:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936f233000 for lustre-MDT0001 00000100:00080000:1.0:1787583146.974457:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787583146.974463:0:3655:0:(import.c:65:import_set_state_nolock()) ffff90937e3c3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787583146.974467:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000001:00100000:3.0:1787583146.976948:0:8437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787583146.976956:0:8437:0:(genops.c:885:class_export_put()) final put ffff90936f0b3800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787583146.976981:0:8437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000020:00000080:3.0:1787583146.976983:0:8437:0:(genops.c:885:class_export_put()) final put ffff909247e55000/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae 00000020:00000080:0.0:1787583146.977102:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f0b3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787583146.977154:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff909247e55000/c54c7da2-d1ec-4db9-98d7-e170a1f2cfae for lustre-OST0000 00000020:00000080:0.0:1787583146.977171:0:15041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936f0b4000 for lustre-OST0000 00000020:00000080:0.0:1787583146.977176:0:15041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff909247e51800 for lustre-OST0000 00000100:00080000:1.0:1787583146.997410:0:3655:0:(import.c:65:import_set_state_nolock()) ffff90937e3c3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787583146.997424:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 223 00000100:00080000:1.0:1787583146.997435:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90937e3c3000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583146.997525:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fce8a80 x1874416435886080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787583147.001574:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435886080:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787583147.001650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583147.002116:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435886080 00000100:00100000:2.0:1787583147.002125:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435886080 00000100:00100000:2.0:1787583147.002159:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787583147.002166:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874416435886080:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1787583147.002183:0:6532:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787583147.019419:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874416435886080:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 17233us (17749us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787583147.019433:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:0.0:1787583147.019470:0:3652:0:(import.c:65:import_set_state_nolock()) ffff90937e3c3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787583147.019475:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787583147.019479:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435886080:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1787583147.406723:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583147.982249:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583147.982274:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435886208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583147.982343:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583147.985619:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435886208 00000100:00100000:0.0:1787583147.985632:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435886208 00000100:00100000:0.0:1787583147.985715:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787583147.985725:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435886208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583147.985756:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787583147.985868:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435886208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (3501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583147.985886:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787583147.986213:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435886208:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787583147.986360:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787583148.430158:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787583149.009000:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787583149.009007:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787583149.009010:0:38:0:(import.c:65:import_set_state_nolock()) ffff90937e3c3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787583149.009018:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 454 00000100:00080000:0.0:1787583149.009023:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787583149.009029:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90937e3c3000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1787583149.009052:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc60000 x1874416435886464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787583149.009134:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435886464:0@lo:38:kworker.0 00000100:00100000:0.0:1787583149.009203:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583149.009284:0:10212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435886464 00000100:00100000:0.0:1787583149.009292:0:10212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435886464 00000100:00100000:0.0:1787583149.009328:0:10212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787583149.009335:0:10212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3652:x1874416435886464:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787583149.009350:0:10212:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787583149.013054:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435886592:0@lo:400:kworker.0 00000100:00100000:3.0:1787583149.013129:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583149.013177:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435886592 00000100:00100000:3.0:1787583149.013195:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435886592 00000100:00100000:3.0:1787583149.013243:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787583149.013250:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3655:x1874416435886592:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787583149.013258:0:6528:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787583149.013305:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3655:x1874416435886592:12345-0@lo:400:kworker.0 Request processed in 54us (177us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787583149.013313:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:3.0:1787583149.013361:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787583149.013365:0:3655:0:(import.c:65:import_set_state_nolock()) ffff90936ee09000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787583149.013369:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787583149.013437:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435886336:0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.013487:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583149.013516:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435886976:0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.013543:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583149.013569:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787583149.013576:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435886848:0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.013597:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583149.013634:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435887360:0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.013655:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583149.013682:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435886336 00000100:00100000:1.0:1787583149.013686:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435886336 00000100:00100000:1.0:1787583149.013720:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787583149.013727:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3654:x1874416435886336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.013763:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bddce63-0a65-4d1b-a395-d8312cc42532+19:3654:x1874416435886336:12345-0@lo:400:kworker.0 Request processed in 38us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583149.013770:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787583149.013793:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435886976 00000100:00100000:1.0:1787583149.013797:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435886976 00000100:00100000:1.0:1787583149.013828:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435887360 00000100:00100000:1.0:1787583149.013831:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435887360 00000100:00100000:1.0:1787583149.013895:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787583149.013903:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435886976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.013933:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435886976:12345-0@lo:400:kworker.0 Request processed in 32us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583149.013938:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787583149.013948:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787583149.013954:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435887360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.013978:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435887360:12345-0@lo:400:kworker.0 Request processed in 24us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583149.013983:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787583149.013999:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435886848 00000100:00100000:1.0:1787583149.014003:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435886848 00000100:00100000:1.0:1787583149.014027:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787583149.014034:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435886848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.014075:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435886848:12345-0@lo:400:kworker.0 Request processed in 42us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583149.014082:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00080000:1.0:1787583149.014108:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787583149.014113:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787583149.014115:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787583149.014135:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc62a00 x1874416435886848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583149.014147:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435886848:0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.014157:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435887360:0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.014165:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:3654:1874416435886336:0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.014173:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435886976:0@lo:400:kworker.0 00000100:00100000:2.0:1787583149.015413:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435886720:0@lo:400:kworker.0 00000100:00100000:2.0:1787583149.015460:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583149.015494:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435887232:0@lo:400:kworker.0 00000100:00100000:2.0:1787583149.015516:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583149.015553:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435886720 00000100:00100000:2.0:1787583149.015558:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435886720 00000100:00100000:2.0:1787583149.015592:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435887232 00000100:00100000:2.0:1787583149.015596:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435887232 00000100:00100000:2.0:1787583149.015625:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787583149.015632:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435887232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583149.015677:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435887232:12345-0@lo:400:kworker.0 Request processed in 45us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583149.015683:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787583149.015697:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787583149.015701:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1874416435886720:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787583149.015706:0:7748:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787583149.015728:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1874416435886720:12345-0@lo:400:kworker.0 Request processed in 27us (268us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787583149.015733:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1787583149.015770:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583149.015801:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787583149.015806:0:3656:0:(import.c:65:import_set_state_nolock()) ffff909245b03000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787583149.015809:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787583149.015813:0:3656:0:(import.c:65:import_set_state_nolock()) ffff909245b03000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787583149.015817:0:3656:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 244 00000100:00080000:2.0:1787583149.015822:0:3656:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff909245b03000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583149.015864:0:3656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f80e00 x1874416435887488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787583149.015902:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435886720:0@lo:400:kworker.0 00010000:00080000:2.0:1787583149.015915:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247f8f480 x1874416435887232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583149.015946:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435887232:0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.017920:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874416435887488:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787583149.017992:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583149.018038:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435887488 00000100:00100000:1.0:1787583149.018045:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435887488 00000100:00100000:1.0:1787583149.018077:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787583149.018083:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1874416435887488:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787583149.018098:0:7748:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787583149.018138:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1874416435887488:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 53us (145us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787583149.018145:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1787583149.018179:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909245b03000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787583149.018193:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787583149.018204:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874416435887488:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:2.0:1787583149.021615:0:6506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787583149.021625:0:6506:0:(genops.c:885:class_export_put()) final put ffff90936db2c800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787583149.021656:0:6506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b124cdab-8363-4433-96a8-2d8722f1634b 00000020:00000080:2.0:1787583149.021659:0:6506:0:(genops.c:885:class_export_put()) final put ffff90937fc02800/b124cdab-8363-4433-96a8-2d8722f1634b 00000020:00000080:1.0:1787583149.022628:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936db2c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787583149.022695:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90937fc02800/b124cdab-8363-4433-96a8-2d8722f1634b for lustre-MDT0000 00000020:00000080:1.0:1787583149.022718:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936d8a0800 for lustre-MDT0000 00000020:00000080:1.0:1787583149.022723:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90937fc00000 for lustre-MDT0000 00000100:00100000:0.0:1787583149.024922:0:10212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3652:x1874416435886464:12345-0@lo:38:kworker.0 Request processed in 15582us (15714us total) trans 0 rc -19/-19 00000100:00080000:1.0:1787583149.025805:0:3652:0:(import.c:65:import_set_state_nolock()) ffff90937e3c3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787583149.025813:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787583149.025817:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435886464:0@lo:38:kworker.0 00000100:00100000:0.0:1787583149.026616:0:10212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:3.0:1787583149.064465:0:3655:0:(import.c:65:import_set_state_nolock()) ffff90936ee09000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787583149.064495:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 223 00000100:00080000:3.0:1787583149.064503:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90936ee09000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787583149.064556:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc88a80 x1874416435887616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787583149.064586:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435886592:0@lo:400:kworker.0 00000100:00100000:3.0:1787583149.064597:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435887104:0@lo:400:kworker.0 00000100:00100000:1.0:1787583149.064657:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874416435887616:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787583149.064661:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583149.064717:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435887104 00000100:00100000:2.0:1787583149.064724:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435887104 00000100:00100000:2.0:1787583149.064779:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787583149.064787:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3655:x1874416435887104:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787583149.064795:0:13828:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787583149.066071:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583149.070516:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3655:x1874416435887104:12345-0@lo:400:kworker.0 Request processed in 5720us (5846us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787583149.070532:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787583149.070562:0:13828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435887616 00000100:00100000:2.0:1787583149.070570:0:13828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435887616 00000100:00100000:0.0:1787583149.074054:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787583149.074067:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874416435887616:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1787583149.074081:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00010000:02000000:0.0:1787583149.074084:0:6527:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1787583149.074085:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9092471b9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787583149.074089:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787583149.074093:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9092471b9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787583149.074096:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 266 00000100:00080000:1.0:1787583149.074103:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9092471b9000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583149.074133:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc63b80 x1874416435887744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787583149.074178:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874416435887616:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 112us (8111us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787583149.074195:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787583149.074544:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435887104:0@lo:400:kworker.0 00000100:00100000:3.0:1787583149.074549:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874416435887744:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787583149.074587:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787583149.074633:0:3652:0:(import.c:65:import_set_state_nolock()) ffff90936ee09000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787583149.074638:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787583149.074641:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874416435887616:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787583149.074661:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435887744 00000100:00100000:1.0:1787583149.074667:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435887744 00000100:00100000:1.0:1787583149.074705:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787583149.074711:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1874416435887744:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1787583149.074720:0:7748:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787583149.074780:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1874416435887744:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 67us (192us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787583149.074787:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1787583149.074865:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9092471b9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787583149.074869:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787583149.074882:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874416435887744:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1787583149.454136:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583149.518682:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583149.518707:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435887872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787583149.518771:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583149.518883:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435887872 00000100:00100000:2.0:1787583149.518890:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435887872 00000100:00100000:2.0:1787583149.518937:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787583149.518947:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435887872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583149.518974:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787583149.519257:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435887872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583149.519442:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435887872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583149.519452:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00010000:3.0:1787583150.481090:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787583151.056897:0:15164:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90936f17dae0 - data ffff909245d00948/ffff90936f38d000 00000020:01000000:2.0:1787583151.057061:0:15164:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff909377152ea0 - data ffff90936655d6c0/ffff909377fee800 00000001:00000004:2.0:1787583151.068292:0:15164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1787583151.127777:0:15164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787583151.127787:0:15164:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787583151.127801:0:15164:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff909247f8c000 x1874416435885568/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787583154 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583151.127824:0:15164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787583151.133231:0:15164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787583151.133239:0:15164:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1787583151.133253:0:15164:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787583151.133256:0:15164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787583151.133552:0:8750:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787583151.133557:0:8750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787583151.133567:0:8750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787583151.137087:0:15164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787583151.137095:0:15164:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1787583151.137133:0:15164:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787583151.137136:0:15164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787583151.137411:0:10012:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787583151.137415:0:10012:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787583151.137425:0:10012:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787583151.138500:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5cdd 00000020:00000080:3.0:1787583151.138508:0:15164:0:(genops.c:885:class_export_put()) final put ffff90937460b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787583151.139030:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90937460b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787583151.140990:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5cf2 00000020:00000080:3.0:1787583151.141000:0:15164:0:(genops.c:885:class_export_put()) final put ffff909374629800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787583151.141047:0:15164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787583151.141053:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787583151.141060:0:15164:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787583151.141064:0:15164:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff909365f1b370) has no exports 00000004:01000000:3.0:1787583151.141228:0:15164:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787583151.141235:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6128 00000020:00000080:3.0:1787583151.141239:0:15164:0:(genops.c:885:class_export_put()) final put ffff90936f2d0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787583151.143768:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff909374629800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787583151.144016:0:15164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787583151.144026:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787583151.144040:0:15164:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787583151.144045:0:15164:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9092464c8000) has no exports 00000020:00000080:3.0:1787583151.144053:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6121 00000020:00000080:3.0:1787583151.144060:0:15164:0:(genops.c:885:class_export_put()) final put ffff90936f2d7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787583151.149929:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f2d0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787583151.150906:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f2d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787583151.151424:0:15164:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787583151.151429:0:15164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787583151.151433:0:15164:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1787583151.151439:0:15164:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787583151.151441:0:15164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787583151.151561:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787583151.151574:0:15164:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787583151.151583:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5fe6 00000020:00000080:3.0:1787583151.151590:0:15164:0:(genops.c:885:class_export_put()) final put ffff90936f0b5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787583151.151596:0:15164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787583151.151601:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787583151.151606:0:15164:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787583151.151610:0:15164:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9092467919b8) has no exports 00000020:00000080:3.0:1787583151.151625:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5fdf 00000020:00000080:3.0:1787583151.151628:0:15164:0:(genops.c:885:class_export_put()) final put ffff90936d8a7800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787583151.153166:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936f2d3000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787583151.153187:0:38:0:(genops.c:885:class_export_put()) final put ffff90936db17000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787583151.153190:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936db17000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787583151.153198:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787583151.153277:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f0b5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787583151.153283:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936d8a7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787583151.153642:0:15164:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787583151.153647:0:15164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787583151.153650:0:15164:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1787583151.153655:0:15164:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787583151.153657:0:15164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787583151.153707:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787583151.153718:0:15164:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787583151.153730:0:15164:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787583151.153736:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5e96 00000020:00000080:3.0:1787583151.153743:0:15164:0:(genops.c:885:class_export_put()) final put ffff90936d90c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787583151.153747:0:15164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787583151.153752:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787583151.153757:0:15164:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787583151.153761:0:15164:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff909373fd99b8) has no exports 00000020:00000080:3.0:1787583151.153765:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5e8f 00000020:00000080:3.0:1787583151.153768:0:15164:0:(genops.c:885:class_export_put()) final put ffff90936d949800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787583151.153964:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936d8a3800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787583151.153969:0:38:0:(genops.c:885:class_export_put()) final put ffff90936f0b0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787583151.153972:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f0b0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787583151.153976:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787583151.154012:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936d90c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787583151.154015:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936d949800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787583151.191928:0:15164:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787583151.192260:0:15164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787583151.192265:0:15164:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787583151.192272:0:15164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787583151.192517:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787583151.192530:0:15164:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787583151.192555:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787583151.192558:0:15164:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787583151.192563:0:15164:0:(genops.c:885:class_export_put()) final put ffff90937460e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787583151.192568:0:15164:0:(genops.c:844:class_export_destroy()) destroying export ffff90937460e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787583151.192578:0:15164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787583151.192798:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5cf9 00000020:00000080:0.0:1787583151.192805:0:15164:0:(genops.c:885:class_export_put()) final put ffff90937462b800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787583151.193595:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936d94d800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787583151.193605:0:38:0:(genops.c:885:class_export_put()) final put ffff90936d8a6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787583151.193607:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936d8a6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787583151.193617:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787583151.193767:0:15164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787583151.193773:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787583151.193780:0:15164:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787583151.193783:0:15164:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff909365f18000) has no exports 00000020:00000080:0.0:1787583151.193804:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787583151.193808:0:15164:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787583151.193813:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5d00 00000020:00000080:0.0:1787583151.193818:0:15164:0:(genops.c:885:class_export_put()) final put ffff90937462e800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787583151.193829:0:15164:0:(tgt_mount.c:187:server_put_mount()) put mount ffff909348740800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787583151.193832:0:15164:0:(obd_mount.c:710:lustre_put_lsi()) put ffff909348740800 3 00000020:01000004:0.0:1787583151.193835:0:15164:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff909348740800 from lustre-MDT0000 00000020:00000080:0.0:1787583151.193862:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787583151.193866:0:15164:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787583151.193869:0:15164:0:(genops.c:885:class_export_put()) final put ffff90937460f000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787583151.193871:0:15164:0:(genops.c:844:class_export_destroy()) destroying export ffff90937460f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787583151.193877:0:15164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1787583151.193947:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90937462b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787583151.193952:0:38:0:(genops.c:885:class_export_put()) final put ffff909374609000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787583151.193953:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff909374609000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787583151.193957:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1787583151.194001:0:15164:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787583151.194005:0:15164:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787583151.194009:0:15164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787583151.194012:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787583151.194015:0:15164:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787583151.194021:0:15164:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff909365fb7000 5bddce63-0a65-4d1b-a395-d8312cc42532 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787583151.194027:0:15164:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff909343e18000) has exports, disconnecting them 00000020:00080000:0.0:1787583151.194031:0:15164:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff909365fb7000), last request at 1787582895 00000020:00000080:0.0:1787583151.194046:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5c9e 00000020:00010000:0.0:1787583151.194050:0:15164:0:(genops.c:1921:obd_stale_export_put()) Put export ffff909365fb7000: total 2 00000100:00080000:0.0:1787583151.194054:0:15164:0:(import.c:65:import_set_state_nolock()) ffff909365fb3000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787583151.194073:0:15164:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff909365fb7000): rc 0 00000020:00080000:0.0:1787583151.194078:0:15164:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff909343e18000) has no exports 00000100:00100000:0.0:1787583151.194128:0:6521:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff909345203a00:6521] 1 exiting: rc = 0 00000020:00000080:1.0:1787583151.194270:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90937462e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1787583151.194298:0:6522:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff90936a2f7a00:6522] 2 exiting: rc = 0 00000100:00100000:1.0:1787583151.194363:0:6520:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff909350a77400:6520] 0 exiting: rc = 1 00000100:00100000:0.0:1787583151.194633:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194641:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194647:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194653:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194659:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194666:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194670:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194676:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194682:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194688:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194693:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194698:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194704:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194709:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194715:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194722:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194728:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194733:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194739:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194745:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194750:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194757:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194762:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194768:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194774:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194780:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194786:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194792:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194798:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194803:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194809:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194815:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194820:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194825:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194830:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194869:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194875:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194880:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194884:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194889:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194894:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194899:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194905:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194910:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194916:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194921:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194927:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194933:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194938:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194943:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194948:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194954:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194959:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.194964:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.195090:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.195100:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.195105:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.195110:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.195115:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:3.0:1787583151.196950:0:10405:0:(genops.c:1907:obd_stale_export_get()) Get export ffff909365fb7000: total 0 00010000:00010000:3.0:1787583151.197020:0:10405:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff909365fb7000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787583151.197056:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367f200/0x19a47956376b61d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b61d0 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197077:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909340030800/0x19a47956376b61e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b61de expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197089:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344ded800/0x19a47956376b5d9a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b5d93 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197104:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344deca00/0x19a47956376b5da8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b5da1 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197139:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909247c52e00/0x19a47956376b643f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b6438 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197152:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909340031600/0x19a47956376b61ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b61a6 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197166:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344dece00/0x19a47956376b645b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b6454 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197190:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344dec600/0x19a47956376b60bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b60b8 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197203:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924770a400/0x19a47956376b620f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b6208 expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197214:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924770b800/0x19a47956376b619f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b6198 expref: 5 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197224:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909247c53a00/0x19a47956376b644d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b6446 expref: 4 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197235:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90936367fa00/0x19a47956376b61bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b61b4 expref: 3 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197246:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924770aa00/0x19a47956376b61c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a47956376b61c2 expref: 2 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583151.197256:0:10405:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff909365fb7000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1787583151.197272:0:10405:0:(genops.c:885:class_export_put()) final put ffff909365fb7000/5bddce63-0a65-4d1b-a395-d8312cc42532 00010000:00010000:3.0:1787583151.197290:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583151.197298:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583151.197301:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787583151.198327:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff909365fb7000/5bddce63-0a65-4d1b-a395-d8312cc42532 for MGS 00000020:00000080:1.0:1787583151.198364:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff909365fb3000 for MGS 00000100:00100000:0.0:1787583151.198553:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.198570:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.198576:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.198583:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583151.198588:0:15164:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787583151.200090:0:15164:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9092465011e0 - data ffff9093666f91b0/ffff90936f1a6400 00000020:01000000:0.0:1787583151.200321:0:15164:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff909344b1bf00 - data ffff909366477798/ffff90936a12dc00 00000020:00000080:0.0:1787583151.201156:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5c82 00000020:00000080:0.0:1787583151.202287:0:15164:0:(genops.c:885:class_export_put()) final put ffff90936a0ba800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787583151.202305:0:15164:0:(tgt_mount.c:187:server_put_mount()) put mount ffff909348740800 from MGS, refs=2 00000020:01000004:0.0:1787583151.202322:0:15164:0:(obd_mount.c:710:lustre_put_lsi()) put ffff909348740800 2 00000020:01000004:0.0:1787583151.202325:0:15164:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff909348740800 from MGS 00000020:00000080:0.0:1787583151.202349:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787583151.202357:0:15164:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787583151.202360:0:15164:0:(genops.c:885:class_export_put()) final put ffff909352906000/MGS 00000020:00000080:0.0:1787583151.202363:0:15164:0:(genops.c:844:class_export_destroy()) destroying export ffff909352906000/MGS for MGS 00000020:01000000:0.0:1787583151.202369:0:15164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787583151.202489:0:15164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787583151.202494:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787583151.202499:0:15164:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787583151.202613:0:15164:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff909374609800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787583151.202620:0:15164:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff909343e1b370) has exports, disconnecting them 00000020:00080000:0.0:1787583151.202625:0:15164:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff909374609800), last request at 1787582896 00000020:00000080:0.0:1787583151.202630:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5d4d 00000020:00080000:0.0:1787583151.202643:0:15164:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff909374609800): rc 0 00000020:00000080:0.0:1787583151.202648:0:15164:0:(genops.c:885:class_export_put()) final put ffff909374609800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787583151.203364:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff90936a0ba800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787583151.203374:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff909374609800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787583151.211504:0:15164:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787583151.211512:0:15164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787583151.211516:0:15164:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787583151.211523:0:15164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787583151.212114:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787583151.212124:0:15164:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787583151.212132:0:15164:0:(obd_mount.c:710:lustre_put_lsi()) put ffff909348740800 1 00000020:00000080:1.0:1787583151.212139:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5c74 00000020:00000080:1.0:1787583151.212148:0:15164:0:(genops.c:885:class_export_put()) final put ffff909342bcd800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787583151.212154:0:15164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787583151.212176:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787583151.212181:0:15164:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787583151.212184:0:15164:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff909373fd8000) has no exports 00000020:00000080:3.0:1787583151.213085:0:15041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff909365f94800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787583151.213096:0:15041:0:(genops.c:885:class_export_put()) final put ffff90937460a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787583151.213099:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff90937460a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787583151.213110:0:15041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787583151.213197:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff909342bcd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787583151.306735:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787583151.306749:0:15164:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787583151.306755:0:15164:0:(genops.c:885:class_export_put()) final put ffff909348747000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787583151.306759:0:15164:0:(genops.c:844:class_export_destroy()) destroying export ffff909348747000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787583151.306765:0:15164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787583151.306923:0:15164:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff909348745800 00000020:02000400:0.0:1787583151.308650:0:15164:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787583151.507249:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583152.536649:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583153.105585:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435888000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787583153.105659:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583153.105732:0:13419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435888000 00000100:00100000:0.0:1787583153.105740:0:13419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435888000 00000100:00100000:0.0:1787583153.105795:0:13419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787583153.105805:0:13419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435888000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583153.105831:0:13419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787583153.105909:0:13419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435888000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583153.105917:0:13419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1787583153.105940:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583153.105981:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435888000:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787583153.556884:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787583154.004960:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1787583154.127217:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787583154.127225:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787583154.127229:0:36:0:(import.c:65:import_set_state_nolock()) ffff90937e3c3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787583154.127251:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 456 00000100:00080000:1.0:1787583154.127257:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787583154.127263:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90937e3c3000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583154.127287:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc61180 x1874416435888256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787583154.127314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787583154.127317:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787583154.127319:0:36:0:(import.c:65:import_set_state_nolock()) ffff90936ee09000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787583154.127322:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 456 00000100:00080000:1.0:1787583154.127325:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787583154.127328:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90936ee09000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583154.127340:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc63480 x1874416435888384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787583154.127349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787583154.127352:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787583154.127354:0:36:0:(import.c:65:import_set_state_nolock()) ffff909245b03000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787583154.127357:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 456 00000100:00080000:1.0:1787583154.127359:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1787583154.127472:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787583154.127486:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435888128:0@lo:400:kworker.0 00000400:00000100:3.0:1787583154.127537:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874416435888128 offset 0 length 224: 4 00000100:00080000:1.0:1787583154.127677:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff909245b03000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583154.127693:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc60a80 x1874416435888512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787583154.127737:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787583154.127741:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787583154.127742:0:36:0:(import.c:65:import_set_state_nolock()) ffff9092471b9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787583154.127752:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 456 00000100:00080000:1.0:1787583154.127754:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787583154.127758:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9092471b9000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583154.127774:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909348841880 x1874416435888896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787583154.127814:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435888768:0@lo:400:kworker.0 00000100:00100000:1.0:1787583154.127883:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583154.127907:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583154.127913:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435888640:0@lo:400:kworker.0 00000100:00100000:1.0:1787583154.127937:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583154.127967:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435888768 00000100:00100000:1.0:1787583154.127974:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435888768 00000100:00100000:0.0:1787583154.128178:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435889152:0@lo:400:kworker.0 00000100:00100000:0.0:1787583154.128209:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583154.128235:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787583154.128241:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435889024:0@lo:400:kworker.0 00000100:00100000:0.0:1787583154.128262:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583154.128330:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435888256:0@lo:38:kworker.0 00000100:00100000:2.0:1787583154.128374:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583154.128401:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874416435888384:0@lo:38:kworker.0 00000100:00100000:2.0:1787583154.128423:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583154.128563:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874416435888512:0@lo:38:kworker.0 00000100:00100000:2.0:1787583154.128587:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583154.128607:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874416435888896:0@lo:38:kworker.0 00000100:00100000:2.0:1787583154.128624:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583154.128651:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435888640 00000100:00100000:2.0:1787583154.128655:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435888640 00000100:00100000:2.0:1787583154.128689:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435889024 00000100:00100000:2.0:1787583154.128692:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435889024 00000100:00100000:2.0:1787583154.128705:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435888384 00000100:00100000:2.0:1787583154.128708:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435888384 00000100:00100000:2.0:1787583154.128716:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435888512 00000100:00100000:2.0:1787583154.128718:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435888512 00000100:00100000:2.0:1787583154.128726:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435888896 00000100:00100000:2.0:1787583154.128728:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435888896 00000100:00100000:2.0:1787583154.128739:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787583154.128748:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435888640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583154.128802:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435888640:12345-0@lo:400:kworker.0 Request processed in 55us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583154.128809:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787583154.128827:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787583154.128833:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435889024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583154.128887:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874416435889024:12345-0@lo:400:kworker.0 Request processed in 54us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583154.128903:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787583154.128917:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787583154.128921:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874416435888384:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787583154.128939:0:6529:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787583154.128971:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874416435888384:12345-0@lo:38:kworker.0 Request processed in 49us (547us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787583154.128977:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787583154.128988:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787583154.128992:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874416435888512:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787583154.129000:0:6529:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787583154.129030:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874416435888512:12345-0@lo:38:kworker.0 Request processed in 37us (441us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787583154.129134:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435888256 00000100:00100000:0.0:1787583154.129139:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435888256 00000100:00100000:0.0:1787583154.129172:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787583154.129176:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874416435888256:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787583154.129187:0:6533:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787583154.129214:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874416435888256:12345-0@lo:38:kworker.0 Request processed in 37us (840us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787583154.129220:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:3.0:1787583154.129486:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787583154.129503:0:13828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787583154.129508:0:13828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1874416435888896:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787583154.129520:0:13828:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787583154.129551:0:13828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1874416435888896:12345-0@lo:38:kworker.0 Request processed in 42us (926us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787583154.129557:0:13828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:3.0:1787583154.129609:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff90937fc62a00 x1874416435888640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583154.129623:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435888640:0@lo:400:kworker.0 00010000:00080000:3.0:1787583154.129654:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff909348842d80 x1874416435889024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583154.129662:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435889024:0@lo:400:kworker.0 00000100:00080000:3.0:1787583154.129702:0:3652:0:(import.c:65:import_set_state_nolock()) ffff90937e3c3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787583154.129707:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787583154.129710:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435888256:0@lo:38:kworker.0 00000100:00080000:3.0:1787583154.129718:0:3652:0:(import.c:65:import_set_state_nolock()) ffff90936ee09000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787583154.129721:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787583154.129724:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874416435888384:0@lo:38:kworker.0 00000100:00080000:3.0:1787583154.129731:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909245b03000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787583154.129734:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787583154.129736:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874416435888512:0@lo:38:kworker.0 00000100:00080000:3.0:1787583154.129743:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9092471b9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787583154.129746:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787583154.129749:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874416435888896:0@lo:38:kworker.0 00000100:00100000:2.0:1787583154.131563:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787583154.131682:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435889152 00000100:00100000:1.0:1787583154.131690:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435889152 00000100:00100000:1.0:1787583154.131752:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787583154.131762:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435888768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583154.131869:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435888768:12345-0@lo:400:kworker.0 Request processed in 109us (3985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583154.131875:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787583154.131889:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787583154.131896:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435889152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583154.131934:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435889152:12345-0@lo:400:kworker.0 Request processed in 39us (3724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583154.131941:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787583154.132005:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435889152:0@lo:400:kworker.0 00000100:00080000:3.0:1787583154.133279:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583154.139182:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435888768:0@lo:400:kworker.0 00010000:00010000:0.0:1787583154.585381:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583154.650737:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583154.650763:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435889280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583154.650841:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583154.650921:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435889280 00000100:00100000:2.0:1787583154.650929:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435889280 00000100:00100000:2.0:1787583154.650976:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787583154.650984:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435889280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583154.651013:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787583154.651267:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435889280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 282us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583154.651275:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787583154.664637:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435889280:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787583155.598181:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787583155.610226:0:15365:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787583155.624736:0:15365:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1787583155.624790:0:15365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.624805:0:15365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.624812:0:15365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.624820:0:15365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.624901:0:15365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787583155.624908:0:15365:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787583155.624932:0:15365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787583155.624936:0:15365:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787583155.624942:0:15365:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787583155.624948:0:15365:0:(import.c:65:import_set_state_nolock()) ffff90936ee09000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787583155.624952:0:15365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787583155.624954:0:15365:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787583155.624957:0:15365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787583155.627922:0:15365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.627939:0:15365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.627945:0:15365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.627967:0:15365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583155.628119:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787583155.628127:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583155.628144:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583155.628149:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583155.628169:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583155.628177:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583155.628183:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787583155.628185:0:6516:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787583155.628188:0:6516:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787583155.628222:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583155.628229:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787583155.628258:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583155.628266:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924713f400/0x19a47956376b61d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b61d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583155.628279:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583155.628282:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583155.628287:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367ee00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583155.628290:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583155.628297:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583155.628313:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583155.628318:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787583155.628320:0:6516:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1787583155.628332:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583155.628337:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787583155.628368:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583155.628377:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583155.628379:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583155.628380:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583155.628402:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435889536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583155.628476:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583155.628662:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435889536 00000100:00100000:0.0:1787583155.628669:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435889536 00000100:00100000:0.0:1787583155.628705:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787583155.628712:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093770b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3655:x1874416435889536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787583155.628718:0:6514:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787583155 with bad export cookie 1847735158332677278 00000100:00100000:3.0:1787583155.629565:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787583155.629579:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435889408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787583155.629621:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583155.629663:0:13742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435889408 00000100:00100000:3.0:1787583155.629667:0:13742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435889408 00000100:00100000:3.0:1787583155.629693:0:13742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787583155.629699:0:13742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3653:x1874416435889408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787583155.629704:0:13742:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787583155 with bad export cookie 1847735158332677278 00000100:00100000:3.0:1787583155.629746:0:13742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3653:x1874416435889408:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (123us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787583155.629752:0:13742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1787583155.629802:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787583155.629806:0:3653:0:(import.c:65:import_set_state_nolock()) ffff909365fb4800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787583155.629809:0:3653:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1787583155.631473:0:15365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787583155.631484:0:15365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90936367ee00/0x19a47956376b61de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b61e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.631507:0:15365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.631515:0:15365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.631521:0:15365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.631613:0:15365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.631637:0:15365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787583155.631645:0:15365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.631650:0:15365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.631656:0:15365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.631681:0:15365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.631695:0:15365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787583155.631712:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787583155.631717:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.631724:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90938216ea00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787583155.631727:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.631735:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787583155.631742:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583155.631747:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787583155.631750:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787583155.631752:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787583155.631836:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583155.631843:0:7469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583155.631862:0:7469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787583155.631866:0:7469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583155.631872:0:7469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787583155.631879:0:7469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583155.631884:0:7469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787583155.631886:0:7469:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787583155.631888:0:7469:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:0.0:1787583155.635522:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093770b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3655:x1874416435889536:12345-0@lo:103:ldlm_bl.0 Request processed in 6805us (7043us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787583155.635535:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787583155.635606:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787583155.645024:0:3653:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.111@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787583155.645029:0:3653:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787583155.645039:0:3653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90937fc60000 x1874416435888128/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787583170 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583155.645055:0:3653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff909247ef7800 x1874416435889536/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787583171 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583155.645064:0:3653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff909247ef5c00 x1874416435889408/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787583171 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787583155.645073:0:3653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787583155.645076:0:3653:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787583155.645077:0:3653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:1.0:1787583155.645462:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.645472:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787583155.645500:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.645507:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90938216ea00/0x19a47956376b60b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b60bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.645640:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583155.645643:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583155.645645:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583155.645736:0:15365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec400/0x19a47956376b5da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.645746:0:15365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec400/0x19a47956376b5da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.645753:0:15365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec400/0x19a47956376b5da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.645759:0:15365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff909344dec400/0x19a47956376b5da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.645776:0:15365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787583155.645781:0:15365:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1787583155.645786:0:15365:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1787583155.645819:0:15365:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1787583155.645823:0:15365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1787583155.645829:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787583155.645835:0:15365:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787583155.645840:0:15365:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff90936f235800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787583155.645862:0:15365:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff909245b05000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787583155.645867:0:15365:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff90936db219b8) has exports, disconnecting them 00000020:00080000:1.0:1787583155.645872:0:15365:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90936f235800), last request at 1787583154 00000020:00000080:1.0:1787583155.645878:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6080 00000100:00080000:1.0:1787583155.645896:0:15365:0:(import.c:65:import_set_state_nolock()) ffff90936f236000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787583155.645941:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787583155.645946:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344dec400/0x19a47956376b5da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.645953:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787583155.645956:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344dec400/0x19a47956376b5da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.645964:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344dec400/0x19a47956376b5da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787583155.645971:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344dec400/0x19a47956376b5da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583155.645976:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787583155.645979:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787583155.645980:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787583155.645990:0:6515:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff909365fb4800 00010000:00010000:1.0:1787583155.645993:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344dec400/0x19a47956376b5da1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.645999:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344dec400/0x19a47956376b5da1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b5da8 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583155.646011:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583155.646012:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583155.646014:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787583155.646027:0:15365:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90936f235800): rc 0 00000020:00000080:1.0:1787583155.646029:0:15365:0:(genops.c:885:class_export_put()) final put ffff90936f235800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1787583155.646040:0:15365:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff909245b05000), last request at 1787583154 00000020:00000080:1.0:1787583155.646043:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5f5a 00000100:00080000:1.0:1787583155.646056:0:15365:0:(import.c:65:import_set_state_nolock()) ffff909245b07800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787583155.646068:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787583155.646075:0:15365:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff909245b05000): rc 0 00000020:00000080:1.0:1787583155.646077:0:15365:0:(genops.c:885:class_export_put()) final put ffff909245b05000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1787583155.646084:0:15365:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa3cd41ca7ae0 00000100:00080000:1.0:1787583155.646102:0:15365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787583155.646108:0:15365:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff90937fc89f80 x1874416435885952/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787583162 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583155.646118:0:15365:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1787583155.647093:0:15365:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787583155.647099:0:15365:0:(import.c:65:import_set_state_nolock()) ffff90937e3c3000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787583155.647241:0:15365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787583155.647245:0:15365:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1787583155.647259:0:15365:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787583155.647311:0:15365:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787583155.647334:0:15365:0:(import.c:65:import_set_state_nolock()) ffff909246692000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787583155.647467:0:7469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583155.647477:0:7469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787583155.647493:0:7469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583155.647500:0:7469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924770b000/0x19a47956376b6454 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a47956376b645b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583155.647511:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583155.647513:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583155.647515:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583155.647707:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583155.647724:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bddce63-0a65-4d1b-a395-d8312cc42532:0:1874416435889920:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787583155.647801:0:15365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787583155.647804:0:15365:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1787583155.647936:0:15365:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787583155.647991:0:15365:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787583155.648003:0:15365:0:(import.c:65:import_set_state_nolock()) ffff909246696800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787583155.648026:0:15365:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90936db219b8) has no exports 00000100:00100000:1.0:1787583155.648333:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bddce63-0a65-4d1b-a395-d8312cc42532:0:1874416435889664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583155.648479:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787583155.648599:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f235800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1787583155.648651:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff909245b05000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1787583155.648671:0:15041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936f236000 for lustre-MDT0001 00000020:00000080:1.0:1787583155.648676:0:15041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff909245b07800 for lustre-MDT0001 00010000:00010000:1.0:1787583155.648694:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787583155.648773:0:3655:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff909365fb4800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787583155.648796:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435888128:0@lo:400:kworker.0 00000100:00100000:0.0:1787583155.648810:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435885952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787583155.648828:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bddce63-0a65-4d1b-a395-d8312cc42532:3655:1874416435889536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583155.648954:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435889792:0@lo:9:umount.0 00000100:00100000:1.0:1787583155.649014:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583155.649046:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435890048:0@lo:9:umount.0 00000100:00100000:1.0:1787583155.649068:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583155.649098:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435889792 00000100:00100000:1.0:1787583155.649105:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435889792 00000100:00100000:1.0:1787583155.649160:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435890048 00000100:00100000:1.0:1787583155.649164:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435890048 00000100:00100000:1.0:1787583155.649185:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787583155.649193:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874416435889792:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787583155.649216:0:8442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5fb5 00000100:00080000:1.0:1787583155.649223:0:8442:0:(import.c:65:import_set_state_nolock()) ffff909245b01800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787583155.649260:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:3.0:1787583155.649498:0:3653:0:(import.c:65:import_set_state_nolock()) ffff909365fb4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787583155.649504:0:3653:0:(import.c:510:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 202 00000100:00080000:3.0:1787583155.649510:0:3653:0:(import.c:624:import_select_connection()) MGC192.168.203.111@tcp: import ffff909365fb4800 using connection 192.168.203.111@tcp/0@lo 00000100:00080000:3.0:1787583155.649518:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583155.650171:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc89f80 x1874416435890176/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787583155.650207:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5bddce63-0a65-4d1b-a395-d8312cc42532:3652:1874416435890176:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1787583155.650235:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874416435890176 offset 0 length 520: 4 00000100:00100000:3.0:1787583155.650271:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bddce63-0a65-4d1b-a395-d8312cc42532:3653:1874416435889408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583155.650513:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3652:x1874416435889792:12345-0@lo:9:umount.0 Request processed in 1319us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583155.650522:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787583155.650610:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787583155.650621:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874416435890048:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787583155.650638:0:8442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b60e9 00000100:00080000:1.0:1787583155.650644:0:8442:0:(import.c:65:import_set_state_nolock()) ffff90937fb93000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787583155.650678:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787583155.650773:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3652:x1874416435890048:12345-0@lo:9:umount.0 Request processed in 155us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583155.650779:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:1.0:1787583155.650805:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787583155.651153:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909246692000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787583155.651172:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787583155.651174:0:3652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787583155.651177:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435889792:0@lo:9:umount.0 00000100:00080000:3.0:1787583155.651206:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909246696800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1787583155.651274:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787583155.651626:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787583155.651709:0:3652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787583155.651714:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435890048:0@lo:9:umount.0 00000020:00080000:1.0:1787583155.659263:0:15365:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90936db219b8) has no exports 00000020:01000000:0.0:1787583155.737693:0:15365:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9092473592a0 - data ffff9093666e9000/ffff90937e572800 00000020:01000000:0.0:1787583155.737984:0:15365:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff909377f61a20 - data ffff909366536510/ffff90936d914c00 00000001:00000004:0.0:1787583155.752681:0:15365:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1787583155.829100:0:15365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787583155.829108:0:15365:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787583155.829115:0:15365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787583155.834326:0:15365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787583155.834334:0:15365:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1787583155.834354:0:15365:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787583155.834356:0:15365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787583155.834743:0:8746:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787583155.834748:0:8746:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1787583155.834756:0:8746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787583155.835345:0:15365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787583155.835348:0:15365:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1787583155.835364:0:15365:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787583155.835366:0:15365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787583155.835657:0:10007:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787583155.835661:0:10007:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1787583155.835669:0:10007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787583155.836495:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5dc4 00000020:00000080:0.0:1787583155.836504:0:15365:0:(genops.c:885:class_export_put()) final put ffff90936db12000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787583155.836912:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90936db12000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787583155.838408:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5dd9 00000020:00000080:0.0:1787583155.838419:0:15365:0:(genops.c:885:class_export_put()) final put ffff90936db28000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787583155.838523:0:15365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1787583155.838529:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787583155.838537:0:15365:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787583155.838541:0:15365:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff90936db20000) has no exports 00000004:01000000:0.0:1787583155.838701:0:15365:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787583155.838709:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b60e2 00000020:00000080:0.0:1787583155.838713:0:15365:0:(genops.c:885:class_export_put()) final put ffff90937fbe1000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787583155.839015:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90936db28000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787583155.839641:0:15365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787583155.839648:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787583155.839657:0:15365:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787583155.839661:0:15365:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff90937fbc4d28) has no exports 00000020:00000080:0.0:1787583155.839668:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b60db 00000020:00000080:0.0:1787583155.839684:0:15365:0:(genops.c:885:class_export_put()) final put ffff909246694000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787583155.839937:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90937fbe1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:0.0:1787583155.840524:0:15365:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787583155.840529:0:15365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787583155.840534:0:15365:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1787583155.840540:0:15365:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787583155.840542:0:15365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787583155.840571:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff909246694000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787583155.840951:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787583155.840963:0:15365:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787583155.840970:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5fa0 00000020:00000080:0.0:1787583155.840977:0:15365:0:(genops.c:885:class_export_put()) final put ffff909365f3b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787583155.841238:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff909246696800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787583155.841245:0:36:0:(genops.c:885:class_export_put()) final put ffff9092471be000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787583155.841247:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9092471be000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787583155.841252:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787583155.841412:0:15365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787583155.841417:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787583155.841484:0:15365:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787583155.841489:0:15365:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9092466899b8) has no exports 00000020:00000080:0.0:1787583155.841495:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5f99 00000020:00000080:0.0:1787583155.841499:0:15365:0:(genops.c:885:class_export_put()) final put ffff909246695800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1787583155.841830:0:15365:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787583155.841833:0:15365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787583155.841836:0:15365:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1787583155.841840:0:15365:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787583155.841842:0:15365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787583155.841919:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff909365f3b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787583155.841925:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff909246695800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787583155.842027:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787583155.842035:0:15365:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1787583155.842047:0:15365:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787583155.842053:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5dfc 00000020:00000080:0.0:1787583155.842058:0:15365:0:(genops.c:885:class_export_put()) final put ffff90936d8ca800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787583155.844559:0:15365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1787583155.844573:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787583155.844582:0:15365:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787583155.844587:0:15365:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff909377ee19b8) has no exports 00000020:00000080:0.0:1787583155.844594:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5df5 00000020:00000080:0.0:1787583155.844601:0:15365:0:(genops.c:885:class_export_put()) final put ffff90937e3c7000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787583155.845249:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff909246692000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787583155.845259:0:36:0:(genops.c:885:class_export_put()) final put ffff90937460c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787583155.845262:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90937460c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787583155.845268:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787583155.845355:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90936d8ca800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787583155.845360:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90937e3c7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787583155.846938:0:15365:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1787583155.846945:0:15365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787583155.846950:0:15365:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787583155.846957:0:15365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787583155.847023:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787583155.847080:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90937e3c3000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787583155.847122:0:15365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787583155.847127:0:15365:0:(genops.c:885:class_export_put()) final put ffff90937e3c4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787583155.847130:0:15365:0:(genops.c:844:class_export_destroy()) destroying export ffff90937e3c4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1787583155.847146:0:15365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787583155.847618:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787583155.847625:0:15365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787583155.847628:0:15365:0:(genops.c:885:class_export_put()) final put ffff90936db14000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787583155.847631:0:15365:0:(genops.c:844:class_export_destroy()) destroying export ffff90936db14000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787583155.847635:0:15365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787583155.847760:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5de0 00000020:00000080:2.0:1787583155.847768:0:15365:0:(genops.c:885:class_export_put()) final put ffff90936db2e000/lustre-MDD0001_UUID 00000020:01000000:2.0:1787583155.847785:0:15365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1787583155.847790:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787583155.847794:0:15365:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787583155.847798:0:15365:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff90936db23370) has no exports 00000020:00000080:2.0:1787583155.847821:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787583155.847825:0:15365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1787583155.847829:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5de7 00000020:00000080:2.0:1787583155.847833:0:15365:0:(genops.c:885:class_export_put()) final put ffff90936db2f800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1787583155.847841:0:15365:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90936d90b000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1787583155.847872:0:15365:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90936d90b000 2 00000020:01000004:2.0:1787583155.847884:0:15365:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90936d90b000 from lustre-MDT0001 00000020:00000080:3.0:1787583155.847943:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90936db2e000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787583155.847948:0:36:0:(genops.c:885:class_export_put()) final put ffff90936db13000/lustre-MDD0001_UUID 00000020:00000080:3.0:1787583155.847950:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90936db13000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787583155.847958:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787583155.848172:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90936db2f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787583155.848217:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787583155.848222:0:15365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1787583155.848225:0:15365:0:(genops.c:885:class_export_put()) final put ffff90936db15800/lustre-MDT0001_UUID 00000020:00000080:2.0:1787583155.848227:0:15365:0:(genops.c:844:class_export_destroy()) destroying export ffff90936db15800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1787583155.848233:0:15365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1787583155.848260:0:15365:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1787583155.848264:0:15365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1787583155.848267:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787583155.848270:0:15365:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787583155.848276:0:15365:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff90936ee0f800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787583155.848285:0:15365:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff909377ee3370) has exports, disconnecting them 00000020:00080000:2.0:1787583155.848289:0:15365:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff90936ee0f800), last request at 1787582916 00000020:00000080:2.0:1787583155.848293:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5e3b 00000020:00080000:2.0:1787583155.848364:0:15365:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90936ee0f800): rc 0 00000020:00000080:2.0:1787583155.848368:0:15365:0:(genops.c:885:class_export_put()) final put ffff90936ee0f800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787583155.849179:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90936ee0f800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1787583155.849890:0:15365:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1787583155.849896:0:15365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787583155.849900:0:15365:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787583155.849905:0:15365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787583155.849929:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90936ee09000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787583155.850090:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787583155.850097:0:15365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787583155.850101:0:15365:0:(genops.c:885:class_export_put()) final put ffff90936ed21000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787583155.850104:0:15365:0:(genops.c:844:class_export_destroy()) destroying export ffff90936ed21000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787583155.850108:0:15365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1787583155.850175:0:15365:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90936d90b000 1 00000020:00000080:3.0:1787583155.850180:0:15365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5d77 00000020:00000080:3.0:1787583155.850186:0:15365:0:(genops.c:885:class_export_put()) final put ffff90936d8a7000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1787583155.850194:0:15365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1787583155.850201:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90936d8a7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787583155.850209:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787583155.850214:0:15365:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787583155.850217:0:15365:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff909377ee0000) has no exports 00000020:00000080:3.0:1787583155.974774:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787583155.974788:0:15365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787583155.974793:0:15365:0:(genops.c:885:class_export_put()) final put ffff90936d908800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787583155.974799:0:15365:0:(genops.c:844:class_export_destroy()) destroying export ffff90936d908800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787583155.974810:0:15365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787583155.974955:0:15365:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90936d909000 00000020:01000000:3.0:1787583155.974974:0:15365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787583155.974978:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787583155.974983:0:15365:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787583155.974986:0:15365:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff909365f199b8) has no exports 00000100:00100000:1.0:1787583155.975407:0:6528:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9093449dce00:6528] 1 exiting: rc = 0 00000100:00100000:1.0:1787583155.975513:0:6527:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff90935893f600:6527] 0 exiting: rc = 1 00000100:00100000:0.0:1787583155.975662:0:13828:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9092465cee00:13828] 4 exiting: rc = 0 00000100:00100000:3.0:1787583155.975809:0:7748:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff909374928800:7748] 3 exiting: rc = 0 00000100:00100000:2.0:1787583155.978246:0:6529:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff90935893f800:6529] 2 exiting: rc = 0 00000100:00100000:3.0:1787583155.979310:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979319:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979325:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979330:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979336:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979341:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979346:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979351:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979357:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979363:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979368:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979374:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979380:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979384:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979390:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979396:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979403:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979408:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979413:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979419:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979424:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979430:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979435:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979440:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979445:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979450:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979456:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979461:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979467:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979490:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979496:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979503:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979509:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979514:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979520:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979525:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979530:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979535:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979541:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979546:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979551:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979556:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979561:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979567:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979572:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979579:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979584:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979589:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979595:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979601:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979606:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979612:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979616:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979621:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979626:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979631:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979636:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979642:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979647:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979653:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979658:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979664:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979670:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583155.979676:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583155.981834:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff909373e3b800:6531] 1 exiting: rc = 0 00000100:00100000:0.0:1787583155.982479:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff909344f64000:6530] 0 exiting: rc = 1 00000100:00100000:0.0:1787583155.983947:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.983957:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.983965:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.983972:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.983977:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.983983:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.983989:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.983994:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.983999:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984005:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984011:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984018:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984024:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984029:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984034:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984038:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984043:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984049:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984055:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984060:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984065:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984070:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984074:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984080:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984085:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984090:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984094:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984099:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984104:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984110:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984115:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984119:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984125:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984156:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984161:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984167:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984172:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984177:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984223:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984231:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984235:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984240:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984246:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984251:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984256:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984261:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984267:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984272:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984277:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984282:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984287:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984292:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984297:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984303:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984308:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984312:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984317:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984322:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984327:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984331:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984336:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984340:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984345:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984350:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.984801:0:10212:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff909247c04e00:10212] 2 exiting: rc = 0 00000100:00100000:1.0:1787583155.984950:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff909373e11c00:6533] 1 exiting: rc = 0 00000100:00100000:2.0:1787583155.985362:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff909373e3b200:6532] 0 exiting: rc = 1 00000100:00100000:0.0:1787583155.985452:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985466:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985474:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985493:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985499:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985512:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985521:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985526:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985533:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985539:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985545:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985552:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985559:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985565:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985570:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985575:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985580:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985604:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985615:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985622:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985631:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985637:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985642:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985648:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985655:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985661:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985667:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985673:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985679:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985699:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985706:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985713:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985718:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985724:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985731:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985737:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985744:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985749:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985761:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985767:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985774:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985792:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985799:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985805:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985811:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985821:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985827:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985833:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985839:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985874:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985882:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985888:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985894:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985916:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985925:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985930:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985936:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985942:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985948:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985953:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985959:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985965:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985971:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583155.985985:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583156.002954:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff909373e10800:6534] 0 exiting: rc = 1 00000100:00100000:3.0:1787583156.003122:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff909373e10c00:6535] 1 exiting: rc = 0 00000100:00100000:1.0:1787583156.003518:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003526:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003530:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003536:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003542:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003546:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003552:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003557:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003562:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003566:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003571:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003575:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003580:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003584:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003588:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003593:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003599:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003604:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003609:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003614:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003619:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003623:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003628:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003633:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003638:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003643:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003649:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003654:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003659:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003664:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003669:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003674:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003679:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003699:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003705:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003709:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003715:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003720:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003726:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003731:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003736:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003742:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003747:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003753:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003758:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003763:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003769:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003774:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003779:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003784:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003789:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003793:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003798:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003802:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003806:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003811:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003816:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003821:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003826:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003831:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003836:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003841:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003873:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.003880:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583156.004323:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff909373e11800:6537] 1 exiting: rc = 0 00000100:00100000:3.0:1787583156.004942:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff909373e11e00:6536] 0 exiting: rc = 1 00000100:00100000:1.0:1787583156.005087:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005093:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005099:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005104:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005120:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005126:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005131:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005147:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005152:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005158:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005162:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005167:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005181:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005187:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005192:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005198:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005203:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005207:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005213:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005218:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005222:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005228:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005233:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005238:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005244:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005249:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005254:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005260:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005265:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005270:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005276:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005281:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005286:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005290:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005295:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005299:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005304:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005309:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005314:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005327:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005332:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005336:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005342:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005356:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005362:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005366:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005371:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005376:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005381:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005386:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005390:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005394:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005399:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005403:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005409:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005414:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005419:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005614:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005621:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005627:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005632:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005637:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005642:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.005647:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006278:0:6539:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff909373e10000:6539] 1 exiting: rc = 0 00000100:00100000:1.0:1787583156.006533:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff909373e11200:6538] 0 exiting: rc = 1 00000100:00100000:0.0:1787583156.006619:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006625:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006630:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006635:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006639:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006644:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006649:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006654:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006672:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006676:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006682:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006687:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006692:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006696:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006701:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006705:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006710:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006714:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006718:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006723:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006728:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006732:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006737:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006743:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006747:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006752:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006757:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006763:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006768:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006773:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006778:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006782:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006787:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006792:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006797:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006802:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006807:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006811:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006817:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006822:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006827:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006833:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006839:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006880:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006885:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006890:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006895:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006899:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006904:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006909:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006915:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006919:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006925:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006930:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006934:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006939:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006944:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006949:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006954:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006959:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006963:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006968:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006972:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583156.006977:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.008156:0:6540:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff909358193e00:6540] 0 exiting: rc = 1 00000100:00100000:1.0:1787583156.008329:0:6542:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff909358192e00:6542] 2 exiting: rc = 0 00000100:00100000:2.0:1787583156.008776:0:6541:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff909373e3a000:6541] 1 exiting: rc = 0 00000100:00100000:1.0:1787583156.009791:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009800:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009805:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009811:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009817:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009821:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009827:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009881:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009889:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009896:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009902:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009907:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009913:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009919:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009925:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009931:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009937:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009951:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009958:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009963:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009969:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009975:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009981:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.009997:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010004:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010009:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010014:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010020:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010025:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010030:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010036:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010042:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010047:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010053:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010058:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010063:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010068:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010073:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010078:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010084:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010089:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010095:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010108:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010114:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010120:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010126:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010131:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010160:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010166:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010183:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010189:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010197:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010204:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010209:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010215:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010222:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010227:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010233:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010238:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010244:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010249:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010255:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010262:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583156.010268:0:15365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787583156.016637:0:15365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787583156.016650:0:15365:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787583156.016656:0:15365:0:(genops.c:885:class_export_put()) final put ffff909348574000/MDS_uuid 00000020:00000080:1.0:1787583156.016661:0:15365:0:(genops.c:844:class_export_destroy()) destroying export ffff909348574000/MDS_uuid for MDS 00000020:01000000:1.0:1787583156.016667:0:15365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787583156.016825:0:15365:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1787583156.623151:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583157.649285:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583158.672911:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787583159.248214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787583159.248223:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787583159.248226:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787583159.248230:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787583159.248233:0:36:0:(import.c:65:import_set_state_nolock()) ffff909245b03000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787583159.248241:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 461 00000100:00080000:2.0:1787583159.248254:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787583159.248260:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff909245b03000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583159.248294:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f81500 x1874416435890304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787583159.248342:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787583159.248345:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787583159.248347:0:36:0:(import.c:65:import_set_state_nolock()) ffff9092471b9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787583159.248350:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 461 00000100:00080000:2.0:1787583159.248353:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787583159.248356:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9092471b9000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583159.248366:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f81180 x1874416435890560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787583159.248421:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435890432:0@lo:400:kworker.0 00000400:00000100:2.0:1787583159.248468:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874416435890432 offset 0 length 224: 4 00000100:00100000:2.0:1787583159.248524:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787583159.248531:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435890688:0@lo:400:kworker.0 00000400:00000100:2.0:1787583159.248550:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874416435890688 offset 0 length 224: 4 00000100:00100000:0.0:1787583159.248610:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874416435890304:0@lo:38:kworker.0 00000400:00000100:0.0:1787583159.248634:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874416435890304 offset 0 length 520: 4 00000100:00100000:0.0:1787583159.248653:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874416435890560:0@lo:38:kworker.0 00000400:00000100:0.0:1787583159.248667:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874416435890560 offset 0 length 520: 4 00010000:00010000:1.0:1787583159.695211:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787583159.785813:0:15566:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787583159.796916:0:15566:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787583159.796963:0:15566:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583159.796983:0:15566:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583159.797010:0:15566:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583159.797017:0:15566:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583159.797031:0:15566:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787583159.797036:0:15566:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787583159.797056:0:15566:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787583159.797066:0:15566:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff909247f81500 x1874416435890304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787583179 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583159.797082:0:15566:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787583159.797119:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909245b03000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787583159.797124:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1787583159.797128:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874416435890304:0@lo:38:kworker.0 00000100:00080000:0.0:1787583159.797153:0:15566:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787583159.797157:0:15566:0:(import.c:65:import_set_state_nolock()) ffff909245b03000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787583159.797165:0:15566:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787583159.797166:0:15566:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787583159.797171:0:15566:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787583159.797311:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787583159.797319:0:10405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583159.797335:0:10405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340031c00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787583159.797339:0:10405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583159.797348:0:10405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787583159.797356:0:10405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583159.797362:0:10405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787583159.797365:0:10405:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787583159.797367:0:10405:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787583159.797382:0:10405:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff909365fb4800 00010000:00010000:1.0:1787583159.797386:0:10405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583159.797392:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909340031c00/0x19a47956376b61b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b61bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583159.797403:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583159.797405:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583159.797406:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787583159.802093:0:15566:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787583159.802120:0:15566:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff909247f82680 x1874416435890432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583175 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583159.802139:0:15566:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787583159.802145:0:15566:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787583159.802171:0:15566:0:(import.c:65:import_set_state_nolock()) ffff909365f3d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787583159.802221:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874416435890816:0@lo:39:umount.0 00000400:00000100:0.0:1787583159.802270:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874416435890816 offset 0 length 224: 4 00000100:00100000:1.0:1787583159.803863:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435890432:0@lo:400:kworker.0 00000100:00080000:1.0:1787583160.270183:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787583160.270193:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787583160.270196:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787583160.270216:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787583160.270294:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787583160.270452:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435890944:0@lo:400:kworker.0 00000400:00000100:0.0:1787583160.270499:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874416435890944 offset 0 length 224: 4 00010000:00010000:1.0:1787583160.729095:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583161.742282:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787583161.807697:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787583161.807707:0:9523:0:(genops.c:885:class_export_put()) final put ffff90937fb93800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787583161.807894:0:15041:0:(genops.c:844:class_export_destroy()) destroying export ffff90937fb93800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787583161.807937:0:15041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90937fb93000 for lustre-OST0001 00000001:00100000:0.0:1787583161.808255:0:8437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787583161.808260:0:8437:0:(genops.c:885:class_export_put()) final put ffff909245b03800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787583161.808313:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff909245b03800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787583161.808359:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff909245b01800 for lustre-OST0000 00010000:00010000:1.0:1787583162.768032:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583163.790885:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787583164.302017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787583164.302028:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787583164.302031:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787583164.302034:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787583164.302195:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435891072:0@lo:400:kworker.0 00000400:00000100:3.0:1787583164.302254:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874416435891072 offset 0 length 224: 4 00010000:00010000:1.0:1787583164.814126:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583165.838890:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583165.965971:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583155/real 1787583155] req@ffff90937fc89f80 x1874416435890176/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787583165 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583165.966004:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90937fc89f80 x1874416435890176/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787583165 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787583165.966025:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909365fb4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787583165.966295:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787583165.966301:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5bddce63-0a65-4d1b-a395-d8312cc42532:3652:1874416435890176:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1787583165.969632:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787583165.969641:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787583165.969645:0:36:0:(import.c:65:import_set_state_nolock()) ffff909365fb4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787583165.969652:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 462 00000100:00080000:2.0:1787583165.969657:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787583165.969664:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.111@tcp: import ffff909365fb4800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583165.969882:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f80380 x1874416435891200/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787583165.969961:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5bddce63-0a65-4d1b-a395-d8312cc42532:3652:1874416435891200:0@lo:250:kworker.0 00000400:00000100:0.0:1787583165.970012:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874416435891200 offset 0 length 520: 4 00000100:00080000:2.0:1787583165.970228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787583165.970232:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787583165.970316:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435891328:0@lo:400:kworker.0 00000400:00000100:1.0:1787583165.970344:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874416435891328 offset 0 length 224: 4 00010000:00010000:1.0:1787583166.862042:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583167.888509:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583168.910134:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583169.038324:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583159/real 1787583159] req@ffff909247ef7800 x1874416435890816/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787583169 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583169.038360:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff909247ef7800 x1874416435890816/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787583169 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787583169.038380:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909365f3d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787583169.038422:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874416435890816:0@lo:39:umount.0 00000100:00080000:1.0:1787583169.038469:0:15566:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787583169.038475:0:15566:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787583169.038481:0:15566:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787583169.039688:0:15566:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583169.039707:0:15566:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583169.039714:0:15566:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583169.039721:0:15566:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583169.039885:0:15566:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787583169.039894:0:15566:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583169.039902:0:15566:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583169.039908:0:15566:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583169.039914:0:15566:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583169.040033:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787583169.040051:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583169.040059:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787583169.040064:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583169.040073:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787583169.040081:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583169.040086:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787583169.040088:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1787583169.040099:0:6515:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff909365fb4800 00010000:00010000:2.0:1787583169.040109:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583169.040116:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90936367e400/0x19a47956376b61c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b61c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583169.040131:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583169.040134:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583169.040140:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787583169.040143:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583169.040150:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787583169.040156:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583169.040162:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787583169.040164:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787583169.040170:0:6515:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff909365fb4800 00010000:00010000:2.0:1787583169.040173:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583169.040179:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583169.040180:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583169.040182:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583169.040245:0:15566:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787583169.040258:0:15566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b6446 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b644d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583169.040269:0:15566:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787583169.040273:0:15566:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1787583169.040275:0:15566:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787583169.040298:0:15566:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787583169.040303:0:15566:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787583169.040308:0:15566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787583169.040314:0:15566:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787583169.040318:0:15566:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff909343e1cd28) has no exports 00000020:00080000:1.0:1787583169.040351:0:15566:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff909343e1cd28) has no exports 00010000:00010000:2.0:1787583169.041324:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787583169.042119:0:15566:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff909247359180 - data ffff9093666e9870/ffff90937e571800 00000020:01000000:1.0:1787583169.042247:0:15566:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff909245b438a0 - data ffff909366679d80/ffff90936f47c800 00100000:10000000:1.0:1787583169.050997:0:15566:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787583169.060994:0:15566:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5f14 00000020:00000080:3.0:1787583169.061006:0:15566:0:(genops.c:885:class_export_put()) final put ffff90936f1d0800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787583169.061087:0:15566:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90936d948800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787583169.061092:0:15566:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90936d948800 2 00000020:01000004:3.0:1787583169.061096:0:15566:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90936d948800 from lustre-OST0000 00000020:00000080:3.0:1787583169.061122:0:15566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787583169.061135:0:15566:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787583169.061138:0:15566:0:(genops.c:885:class_export_put()) final put ffff90936f1d3000/lustre-OST0000_UUID 00000020:00000080:3.0:1787583169.061140:0:15566:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f1d3000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787583169.061147:0:15566:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787583169.061193:0:15566:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787583169.061197:0:15566:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787583169.061201:0:15566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787583169.061206:0:15566:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787583169.061212:0:15566:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90936ee0b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787583169.061218:0:15566:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff909373fdcd28) has exports, disconnecting them 00000020:00080000:3.0:1787583169.061223:0:15566:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90936ee0b000), last request at 1787582937 00000020:00000080:3.0:1787583169.061227:0:15566:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5f3e 00000020:00080000:3.0:1787583169.061236:0:15566:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90936ee0b000): rc 0 00000020:00000080:3.0:1787583169.061240:0:15566:0:(genops.c:885:class_export_put()) final put ffff90936ee0b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787583169.061583:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f1d0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787583169.063544:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936ee0b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787583169.063978:0:15566:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787583169.063994:0:15566:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787583169.063997:0:15566:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787583169.064002:0:15566:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787583169.064170:0:15566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787583169.064177:0:15566:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787583169.064184:0:15566:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787583169.064188:0:15566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787583169.064192:0:15566:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787583169.064198:0:15566:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff90936d94c800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787583169.064204:0:15566:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9092464cb370) has exports, disconnecting them 00000020:00080000:2.0:1787583169.064209:0:15566:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff90936d94c800), last request at 1787582937 00000020:00000080:2.0:1787583169.064213:0:15566:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5f53 00000020:00080000:2.0:1787583169.064226:0:15566:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90936d94c800): rc 0 00000020:00000080:2.0:1787583169.064232:0:15566:0:(genops.c:885:class_export_put()) final put ffff90936d94c800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787583169.064259:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff909245b03000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787583169.064267:0:38:0:(genops.c:885:class_export_put()) final put ffff9092417cc000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787583169.064270:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9092417cc000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787583169.064277:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787583169.064677:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936d94c800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787583169.066933:0:15566:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787583169.066940:0:15566:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787583169.066944:0:15566:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787583169.066951:0:15566:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787583169.066979:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff909365f3d800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787583169.067172:0:15566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787583169.067181:0:15566:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1787583169.067186:0:15566:0:(genops.c:885:class_export_put()) final put ffff90936ee0a800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1787583169.067190:0:15566:0:(genops.c:844:class_export_destroy()) destroying export ffff90936ee0a800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1787583169.067195:0:15566:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787583169.067256:0:15566:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90936d948800 1 00000020:00000080:0.0:1787583169.067262:0:15566:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5edc 00000020:00000080:0.0:1787583169.067268:0:15566:0:(genops.c:885:class_export_put()) final put ffff90936db28800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787583169.067277:0:15566:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787583169.067284:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90936db28800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787583169.067292:0:15566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787583169.067297:0:15566:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787583169.067300:0:15566:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff909373fdb370) has no exports 00000020:00000080:0.0:1787583169.106330:0:15566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787583169.106343:0:15566:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787583169.106361:0:15566:0:(genops.c:885:class_export_put()) final put ffff90936d94d000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787583169.106366:0:15566:0:(genops.c:844:class_export_destroy()) destroying export ffff90936d94d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787583169.106377:0:15566:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787583169.106551:0:15566:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90936d94f800 00000020:02000400:0.0:1787583169.106604:0:15566:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787583169.937502:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583170.962261:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787583171.021961:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787583171.021970:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787583171.021973:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787583171.021976:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787583171.022068:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435891456:0@lo:400:kworker.0 00000400:00000100:2.0:1787583171.022117:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874416435891456 offset 0 length 224: 4 00010000:00010000:2.0:1787583171.992201:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583173.006809:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787583173.274280:0:15768:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787583173.308065:0:15768:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787583173.308198:0:15768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583173.308220:0:15768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583173.308229:0:15768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583173.308236:0:15768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583173.308268:0:15768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787583173.308275:0:15768:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787583173.308308:0:15768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787583173.308323:0:15768:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff909247f81180 x1874416435890560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787583179 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583173.308340:0:15768:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787583173.308346:0:15768:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787583173.308354:0:15768:0:(import.c:65:import_set_state_nolock()) ffff9092471b9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787583173.308359:0:15768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787583173.308363:0:15768:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff909247f81180 x1874416435890560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787583179 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583173.308370:0:15768:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787583173.308373:0:15768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00010000:00010000:0.0:1787583173.308426:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583173.308438:0:10405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583173.308447:0:10405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367ec00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583173.308451:0:10405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583173.308461:0:10405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583173.308470:0:10405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583173.308477:0:10405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787583173.308480:0:10405:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787583173.308483:0:10405:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787583173.308503:0:10405:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff909365fb4800 00010000:00010000:0.0:1787583173.308507:0:10405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583173.308514:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b6198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b619f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583173.308529:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583173.308530:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583173.308550:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583173.308590:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874416435890560:0@lo:38:kworker.0 00000100:00080000:1.0:1787583173.311057:0:15768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787583173.311080:0:15768:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff909247f82a00 x1874416435890688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583175 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583173.311127:0:15768:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff909348843100 x1874416435890944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583176 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583173.311146:0:15768:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff909247f82300 x1874416435891072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583180 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583173.311161:0:15768:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff909247f83100 x1874416435891328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583181 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583173.311176:0:15768:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff909247f80700 x1874416435891456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583187 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583173.311184:0:15768:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1787583173.311225:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874416435891328:0@lo:400:kworker.0 00000100:00080000:1.0:1787583173.311262:0:15768:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787583173.311291:0:15768:0:(import.c:65:import_set_state_nolock()) ffff9092471bf000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787583173.311346:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435891456:0@lo:400:kworker.0 00000100:00100000:1.0:1787583173.311355:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435890944:0@lo:400:kworker.0 00000100:00100000:1.0:1787583173.311401:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874416435891584:0@lo:39:umount.0 00000400:00000100:1.0:1787583173.311462:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874416435891584 offset 0 length 224: 4 00000100:00100000:3.0:1787583173.312076:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874416435890688:0@lo:400:kworker.0 00000100:00100000:3.0:1787583173.312110:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435891072:0@lo:400:kworker.0 00010000:00010000:3.0:1787583174.035512:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583175.054880:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583176.080453:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787583176.142420:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787583176.142443:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787583177.102366:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583178.126509:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583179.150044:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583180.174866:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583180.494615:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583165/real 1787583165] req@ffff909247f80380 x1874416435891200/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787583180 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583180.494649:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff909247f80380 x1874416435891200/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787583180 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787583180.494691:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909365fb4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787583180.494710:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787583180.494714:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5bddce63-0a65-4d1b-a395-d8312cc42532:3652:1874416435891200:0@lo:250:kworker.0 00000100:00080000:3.0:1787583180.494913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787583180.494919:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787583180.494922:0:36:0:(import.c:65:import_set_state_nolock()) ffff909365fb4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787583180.494927:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 473 00000100:00080000:3.0:1787583180.494932:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787583180.494939:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.111@tcp: import ffff909365fb4800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787583180.494982:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc8b100 x1874416435891712/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787583180.495043:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5bddce63-0a65-4d1b-a395-d8312cc42532:3652:1874416435891712:0@lo:250:kworker.0 00000400:00000100:1.0:1787583180.495088:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874416435891712 offset 0 length 520: 4 00010000:00010000:0.0:1787583181.198057:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583182.222193:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583183.246113:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583183.565992:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583173/real 1787583173] req@ffff909348843b80 x1874416435891584/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787583183 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583183.566024:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff909348843b80 x1874416435891584/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787583183 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787583183.566042:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9092471bf000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787583183.566066:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874416435891584:0@lo:39:umount.0 00000100:00080000:2.0:1787583183.566174:0:15768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787583183.566179:0:15768:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787583183.566184:0:15768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787583183.569776:0:15768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583183.569794:0:15768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583183.569802:0:15768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583183.569809:0:15768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583183.569834:0:15768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787583183.569841:0:15768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583183.570394:0:15768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583183.570402:0:15768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583183.570408:0:15768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583183.570513:0:15768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787583183.570519:0:15768:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787583183.570571:0:15768:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787583183.570576:0:15768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787583183.570581:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787583183.570587:0:15768:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787583183.570591:0:15768:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff90924668b370) has no exports 00000020:00080000:2.0:1787583183.570612:0:15768:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff90924668b370) has no exports 00010000:00010000:0.0:1787583183.572244:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787583183.572257:0:10405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583183.572268:0:10405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583183.572272:0:10405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583183.572449:0:10405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583183.572458:0:10405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583183.572464:0:10405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787583183.572467:0:10405:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787583183.572470:0:10405:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787583183.572487:0:10405:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff909365fb4800 00010000:00010000:0.0:1787583183.572491:0:10405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583183.572497:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90936367e800/0x19a47956376b61a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b61ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583183.572512:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583183.572516:0:10405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583183.572538:0:10405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583183.572541:0:10405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583183.572548:0:10405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583183.572554:0:10405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583183.572722:0:10405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787583183.572726:0:10405:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787583183.572728:0:10405:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787583183.572735:0:10405:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff909365fb4800 00010000:00010000:0.0:1787583183.572738:0:10405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583183.572745:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924770a000/0x19a47956376b6438 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b643f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583183.572759:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583183.572761:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583183.572763:0:10405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583183.573843:0:7469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787583183.579113:0:15768:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9092465010c0 - data ffff909245ce06c0/ffff90937fbca400 00000020:01000000:2.0:1787583183.579274:0:15768:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90936f17dea0 - data ffff909245d02438/ffff90937fb88000 00100000:10000000:2.0:1787583183.588806:0:15768:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787583183.597048:0:15768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b603a 00000020:00000080:3.0:1787583183.597058:0:15768:0:(genops.c:885:class_export_put()) final put ffff9092471bb800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787583183.597077:0:15768:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90936db2f000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787583183.597080:0:15768:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90936db2f000 2 00000020:01000004:3.0:1787583183.597083:0:15768:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90936db2f000 from lustre-OST0001 00000020:00000080:3.0:1787583183.597104:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787583183.597112:0:15768:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787583183.597114:0:15768:0:(genops.c:885:class_export_put()) final put ffff909246695000/lustre-OST0001_UUID 00000020:00000080:3.0:1787583183.597117:0:15768:0:(genops.c:844:class_export_destroy()) destroying export ffff909246695000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787583183.597123:0:15768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1787583183.597146:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9092471bb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1787583183.597463:0:15768:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5bddce63-0a65-4d1b-a395-d8312cc42532->MGS 00010000:00010000:3.0:1787583183.597478:0:15768:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344ded600/0x19a47956376b5d93 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b5d9a expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787583183.597490:0:15768:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344ded600/0x19a47956376b5d93 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b5d9a expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583183.597496:0:15768:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787583183.597499:0:15768:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787583183.597501:0:15768:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787583183.597528:0:15768:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff909365fb4800 00010000:00010000:3.0:1787583183.597532:0:15768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344ded600/0x19a47956376b5d93 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b5d9a expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583183.597547:0:15768:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344ded200/0x19a47956376b6208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a47956376b620f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787583183.597555:0:15768:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344ded200/0x19a47956376b6208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a47956376b620f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583183.597560:0:15768:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787583183.597562:0:15768:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787583183.597565:0:15768:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787583183.597573:0:15768:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff909365fb4800 00010000:00010000:3.0:1787583183.597576:0:15768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344ded200/0x19a47956376b6208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a47956376b620f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787583183.598257:0:15768:0:(import.c:65:import_set_state_nolock()) ffff909365fb4800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787583183.598265:0:15768:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787583183.598267:0:15768:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787583183.598268:0:15768:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787583183.598273:0:15768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787583183.598284:0:15768:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90937fc8b100 x1874416435891712/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787583200 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787583183.598303:0:15768:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787583183.598306:0:15768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:0.0:1787583183.598729:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5bddce63-0a65-4d1b-a395-d8312cc42532:3652:1874416435891712:0@lo:250:kworker.0 10000000:01000000:3.0:1787583183.598827:0:15768:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787583183.598837:0:15768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b5c90 00000020:00000080:3.0:1787583183.598869:0:15768:0:(genops.c:885:class_export_put()) final put ffff909348574800/5bddce63-0a65-4d1b-a395-d8312cc42532 00000020:01000000:3.0:1787583183.598888:0:15768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.111@tcp (flags='') 00000020:00000080:3.0:1787583183.598897:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787583183.598903:0:15768:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.111@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787583183.598917:0:15768:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff909343e199b8) has no exports 00000020:00000080:0.0:1787583183.598982:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff909348574800/5bddce63-0a65-4d1b-a395-d8312cc42532 for MGC192.168.203.111@tcp 10000000:01000000:1.0:1787583183.599055:0:6525:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787583183.599486:0:15768:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.111@tcp: client import never connected 00000100:00080000:3.0:1787583183.599490:0:15768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787583183.599492:0:15768:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787583183.599495:0:15768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787583183.599498:0:15768:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787583183.599543:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787583183.599549:0:15768:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.111@tcp (uuid 5bddce63-0a65-4d1b-a395-d8312cc42532) 00000020:01000000:3.0:1787583183.599555:0:15768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787583183.599559:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787583183.599562:0:15768:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787583183.599567:0:15768:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9092471ba800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787583183.599573:0:15768:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff90924668cd28) has exports, disconnecting them 00000020:00080000:3.0:1787583183.599577:0:15768:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9092471ba800), last request at 1787582959 00000020:00000080:3.0:1787583183.599581:0:15768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6064 00000020:00080000:3.0:1787583183.599591:0:15768:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9092471ba800): rc 0 00000020:00000080:3.0:1787583183.599595:0:15768:0:(genops.c:885:class_export_put()) final put ffff9092471ba800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787583183.599727:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff909365fb4800 for MGC192.168.203.111@tcp 00000020:00000080:0.0:1787583183.599734:0:36:0:(genops.c:885:class_export_put()) final put ffff909365fb6000/5bddce63-0a65-4d1b-a395-d8312cc42532 00000020:00000080:0.0:1787583183.599743:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff909365fb6000/5bddce63-0a65-4d1b-a395-d8312cc42532 for MGC192.168.203.111@tcp 00000020:01000000:0.0:1787583183.599748:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.111@tcp (5bddce63-0a65-4d1b-a395-d8312cc42532) 00000020:00000080:0.0:1787583183.602415:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9092471ba800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787583183.602456:0:15768:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787583183.602460:0:15768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787583183.602464:0:15768:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787583183.602470:0:15768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787583183.602670:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787583183.602679:0:15768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787583183.602685:0:15768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787583183.602691:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787583183.602696:0:15768:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787583183.602702:0:15768:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9092471ba000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787583183.602708:0:15768:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff909246688000) has exports, disconnecting them 00000020:00080000:0.0:1787583183.602712:0:15768:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9092471ba000), last request at 1787582959 00000020:00000080:0.0:1787583183.602715:0:15768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6079 00000020:00080000:0.0:1787583183.602729:0:15768:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9092471ba000): rc 0 00000020:00000080:0.0:1787583183.602734:0:15768:0:(genops.c:885:class_export_put()) final put ffff9092471ba000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1787583183.602935:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9092471b9000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787583183.602953:0:36:0:(genops.c:885:class_export_put()) final put ffff9092471bd000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787583183.602962:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9092471bd000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787583183.602972:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787583183.604184:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9092471ba000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1787583183.604210:0:15768:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787583183.604213:0:15768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787583183.604217:0:15768:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787583183.604220:0:15768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787583183.604296:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9092471bf000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1787583183.655524:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787583183.656021:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787583183.656171:0:10405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1787583183.656268:0:7469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1787583183.656377:0:13741:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff90936ee96400:13741] 2 exiting: rc = 0 00000100:00100000:1.0:1787583183.656438:0:6511:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90935afda400:6511] 1 exiting: rc = 0 00000100:00100000:3.0:1787583183.656594:0:6510:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff909345709800:6510] 0 exiting: rc = 1 00000100:00100000:1.0:1787583183.656650:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583183.657111:0:13742:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff90936ef11200:13742] 4 exiting: rc = 0 00000100:00100000:1.0:1787583183.657124:0:6513:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90934a239600:6513] 1 exiting: rc = 0 00000100:00100000:3.0:1787583183.657200:0:6512:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff909351219200:6512] 0 exiting: rc = 1 00000100:00100000:1.0:1787583183.657387:0:6514:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff909343e01200:6514] 2 exiting: rc = 0 00000100:00100000:1.0:1787583183.658004:0:8470:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff90936ef10c00:8470] 3 exiting: rc = 0 00000100:00100000:1.0:1787583183.658066:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658073:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658079:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658087:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658092:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658098:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658104:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658110:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658116:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658121:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658126:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658132:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658137:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658143:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658149:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658155:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658161:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658166:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658182:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658189:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658194:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658199:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658205:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658210:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658216:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658221:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658226:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658242:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658247:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658253:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658259:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658398:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658403:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658408:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658413:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658418:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658423:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658429:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658434:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658439:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658444:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658449:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658455:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658460:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658465:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658471:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658477:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658482:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658487:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658491:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658496:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658501:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658505:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658510:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658516:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658525:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658531:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658537:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658542:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658547:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658553:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658558:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658571:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.658576:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787583183.659773:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787583183.659783:0:15768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787583183.659788:0:15768:0:(genops.c:885:class_export_put()) final put ffff9092471bf800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787583183.659792:0:15768:0:(genops.c:844:class_export_destroy()) destroying export ffff9092471bf800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787583183.659799:0:15768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787583183.660009:0:15768:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90936db2f000 1 00000020:00000080:1.0:1787583183.660016:0:15768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19a47956376b6009 00000020:00000080:1.0:1787583183.660021:0:15768:0:(genops.c:885:class_export_put()) final put ffff909246694800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787583183.660042:0:15768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787583183.660045:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787583183.660051:0:15768:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787583183.660054:0:15768:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9092464ccd28) has no exports 00000020:00000080:3.0:1787583183.660159:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff909246694800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787583183.693313:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787583183.693326:0:15768:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787583183.693333:0:15768:0:(genops.c:885:class_export_put()) final put ffff90936f1d7800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787583183.693338:0:15768:0:(genops.c:844:class_export_destroy()) destroying export ffff90936f1d7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787583183.693344:0:15768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787583183.693648:0:15768:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90936f1d6000 00000020:01000000:1.0:1787583183.693668:0:15768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787583183.693672:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787583183.693677:0:15768:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787583183.693681:0:15768:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff90936db24d28) has no exports 00000020:00000080:1.0:1787583183.693700:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787583183.693705:0:15768:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787583183.693708:0:15768:0:(genops.c:885:class_export_put()) final put ffff90936db29000/OSS_uuid 00000020:00000080:1.0:1787583183.693803:0:15768:0:(genops.c:844:class_export_destroy()) destroying export ffff90936db29000/OSS_uuid for OSS 00000020:01000000:1.0:1787583183.693808:0:15768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787583183.694115:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff909377f1d600:8442] 0 exiting: rc = 1 00000100:00100000:0.0:1787583183.694332:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff909377f21400:8444] 1 exiting: rc = 0 00000100:00080000:3.0:1787583183.694386:0:6523:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787583183.694386:0:8752:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff909245afd000:8752] 3 exiting: rc = 0 00000100:00100000:2.0:1787583183.694452:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff90936d89d200:8445] 2 exiting: rc = 0 00000100:00100000:1.0:1787583183.694531:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694540:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694561:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694566:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694572:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694578:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694582:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694587:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694592:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694597:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694601:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694606:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694611:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694617:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694622:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694627:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694631:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694635:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694640:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694645:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694650:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694655:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694660:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694665:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694670:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694675:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694680:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694685:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694690:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694695:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694701:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.694705:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695074:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695083:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695089:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695096:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695101:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695113:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695117:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695128:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695135:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695140:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695145:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695150:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695155:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695160:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695166:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695171:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695176:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695181:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695186:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695190:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695201:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695207:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695212:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695217:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695223:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695315:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695323:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695328:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695335:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695340:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695345:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.695350:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787583183.696630:0:13419:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff90937e5e2400:13419] 2 exiting: rc = 0 00000100:00100000:2.0:1787583183.698616:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff909344aeb400:8447] 1 exiting: rc = 0 00000100:00100000:3.0:1787583183.700471:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90936d8b8400:8446] 0 exiting: rc = 1 00000100:00100000:2.0:1787583183.700676:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700686:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700693:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700698:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700704:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700709:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700714:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700720:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700725:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700731:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700737:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700742:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700747:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700752:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700758:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700764:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700769:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700776:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700782:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700787:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700815:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700820:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700834:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.700840:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701389:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701398:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701404:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701409:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701414:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701419:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701423:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701428:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701439:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701444:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701449:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701454:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701460:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701464:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701470:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701475:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701480:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701485:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701490:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701495:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701500:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701505:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701510:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701515:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701520:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701525:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701530:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701535:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701540:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701544:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701548:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701561:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701566:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701570:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701574:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701579:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701584:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701589:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701594:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.701606:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.703297:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90937e3d9a00:8448] 0 exiting: rc = 1 00000100:00100000:2.0:1787583183.703499:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90937e3d8a00:8449] 1 exiting: rc = 0 00000100:00100000:0.0:1787583183.703720:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90937e3d9800:8450] 2 exiting: rc = 0 00000100:00100000:2.0:1787583183.703817:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705340:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705354:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705360:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705365:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705371:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705377:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705383:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705388:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705393:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705399:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705405:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705411:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705418:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705424:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705429:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705435:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705441:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705446:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705452:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705456:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705461:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705478:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705484:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705489:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705508:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705513:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705519:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705525:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705530:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705536:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705542:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705548:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705553:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705558:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705563:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705569:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705574:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705580:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705585:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705590:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705596:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705601:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705607:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705613:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705618:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705639:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705645:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705650:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705656:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705662:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705668:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705674:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705679:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705685:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705692:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705705:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705711:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705717:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705723:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705735:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705740:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705745:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787583183.705756:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787583183.721703:0:8452:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90937e3d8e00:8452] 1 exiting: rc = 0 00000100:00100000:0.0:1787583183.721897:0:8451:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90937e3d9200:8451] 0 exiting: rc = 1 00000100:00100000:1.0:1787583183.721985:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.721993:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.721999:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722045:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722079:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722086:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722091:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722109:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722114:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722119:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722123:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722128:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722134:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722140:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722156:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722162:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722167:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722172:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722177:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722183:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722189:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722201:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722207:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722212:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722217:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722222:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722228:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722234:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722240:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722245:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722250:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722255:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722259:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722265:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722270:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722276:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722281:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722286:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722291:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722296:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722301:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722306:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722318:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722323:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722329:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722333:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722338:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722343:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722348:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722352:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722356:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722360:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722365:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722370:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722374:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722378:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722383:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722389:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722394:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722399:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722404:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722411:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722416:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.722421:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723119:0:8454:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90936dab9c00:8454] 1 exiting: rc = 0 00000100:00100000:0.0:1787583183.723185:0:8453:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90936dab9200:8453] 0 exiting: rc = 1 00000100:00100000:1.0:1787583183.723428:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723436:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723441:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723447:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723453:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723459:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723465:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723471:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723477:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723493:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723500:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723506:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723521:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723527:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723533:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723539:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723546:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723552:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723557:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723562:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723568:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723587:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723594:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723599:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723605:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723611:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723617:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723622:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723629:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723635:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723641:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723649:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723657:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.723678:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724008:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724019:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724025:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724031:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724037:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724044:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724050:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724056:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724063:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724073:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724081:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724111:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724122:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724140:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724161:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724167:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724173:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724179:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724186:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724255:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724264:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724270:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724277:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724297:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724304:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724310:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724315:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724321:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724327:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787583183.724340:0:15768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787583183.752219:0:15768:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787583202.463995:0:16533:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787583212.190618:0:17132:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787583212.191162:0:17132:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787583212.191164:0:17132:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787583212.191333:0:17132:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff909248438000 00000020:01000004:3.0:1787583212.191350:0:17132:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787583212.191357:0:17132:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787583212.191372:0:17132:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff909246793370) 00000020:00000080:3.0:1787583212.191384:0:17132:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787583212.263693:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787583212.273758:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787583212.279663:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1787583212.280926:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1787583212.281143:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787583212.282667:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787583212.283080:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1787583212.283279:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1787583212.283699:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1787583212.284878:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787583212.285107:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787583212.285546:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787583212.286110:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787583212.287153:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787583212.287930:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1787583212.288646:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1787583212.289594:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1787583212.289948:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787583212.290158:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787583212.293596:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.294302:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.295177:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787583212.295408:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.295729:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787583212.296359:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.296699:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787583212.297788:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787583212.298090:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.298273:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.299392:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787583212.299903:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.300267:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.300662:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.301759:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787583212.302085:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787583212.302261:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787583212.302773:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.306928:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.308893:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.309191:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.309395:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787583212.309718:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.309984:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.310273:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787583212.310558:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787583212.310787:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1787583212.312996:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1787583212.314578:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1787583212.315084:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1787583212.315272:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1787583212.315751:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1787583212.316020:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1787583212.316244:0:17132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:0.0:1787583212.321025:0:17132:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787583212.321250:0:17132:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787583212.321257:0:17132:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787583212.321268:0:17132:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b724d 00000020:01000004:0.0:1787583212.321276:0:17132:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787583212.321280:0:17132:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787583212.321286:0:17132:0:(tgt_mount.c:101:server_register_mount()) register mount ffff909248438000 from MGS 00000020:01000004:0.0:1787583212.321290:0:17132:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787583212.321313:0:17132:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90937fbc0000) 00000020:00000080:0.0:1787583212.321324:0:17132:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787583212.321390:0:17132:0:(tgt_mount.c:153:server_get_mount()) get mount ffff909248438000 from MGS, refs=2 00080000:01000000:0.0:1787583212.321395:0:17132:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787583212.321399:0:17132:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b725b 00000100:00100000:0.0:1787583212.321492:0:17132:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787583212.321616:0:17132:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787583212.321622:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787583212.322655:0:17132:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787583212.322665:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787583212.323769:0:17132:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787583212.323969:0:17132:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787583212.323975:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787583212.324775:0:17132:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787583212.324783:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787583212.325247:0:17132:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787583212.325254:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787583212.347567:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583212.347573:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583212.347576:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583212.348021:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583212.348024:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583212.348033:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583212.348562:0:17132:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787583212.350578:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787583212.355081:0:17132:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787583212.355744:0:17144:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787583212.355789:0:17132:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787583212.355820:0:17132:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787583212.356399:0:17132:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787583212.356704:0:17132:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787583212.356960:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787583212.356967:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787583212.363476:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787583212.363487:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787583212.363974:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787583212.363980:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787583212.364716:0:17132:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787583212.364747:0:17132:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.111@tcp' 00000020:01000004:1.0:1787583212.364749:0:17132:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787583212.364780:0:17132:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.111@tcp (typ=mgc) 00000020:00000080:1.0:1787583212.364794:0:17132:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.111@tcp (ffff909373fd99b8) 00000020:00000080:1.0:1787583212.364809:0:17132:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787583212.364921:0:17132:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909247f16800@MGC192.168.203.111@tcp: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1787583212.365074:0:17132:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.111@tcp-0 is initialized 00000040:01000000:1.0:1787583212.365086:0:17132:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787583212.370179:0:17149:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787583212.372700:0:17151:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787583212.373008:0:17132:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.111@tcp (uuid ea761437-c095-48a5-91f7-0c431111ca6a) 00000020:00000080:1.0:1787583212.373167:0:17132:0:(genops.c:1385:class_connect()) connect: client ea761437-c095-48a5-91f7-0c431111ca6a, cookie 0x19a47956376b7269 00000100:00080000:1.0:1787583212.373179:0:17132:0:(import.c:510:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787583212.373186:0:17132:0:(import.c:624:import_select_connection()) MGC192.168.203.111@tcp: import ffff909247f16800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583212.373219:0:17132:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909348842680 x1874416435891840/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787583212.373247:0:17132:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ea761437-c095-48a5-91f7-0c431111ca6a->MGS 00000020:01000004:1.0:1787583212.373272:0:17132:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787583212.373278:0:17132:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787583212.373290:0:17132:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff909373fdb370) 00000020:00000080:1.0:1787583212.373302:0:17132:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787583212.376198:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea761437-c095-48a5-91f7-0c431111ca6a:3652:1874416435891840:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787583212.376273:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583212.376350:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435891840 00000100:00100000:0.0:1787583212.376358:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435891840 00000100:00100000:0.0:1787583212.376397:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787583212.376404:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3652:x1874416435891840:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787583212.376440:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ea761437-c095-48a5-91f7-0c431111ca6a@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:0.0:1787583212.376466:0:17145:0:(genops.c:1385:class_connect()) connect: client ea761437-c095-48a5-91f7-0c431111ca6a, cookie 0x19a47956376b7277 00000100:00080000:0.0:1787583212.376596:0:17145:0:(import.c:65:import_set_state_nolock()) ffff90936f0b2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787583212.376647:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+5:3652:x1874416435891840:12345-0@lo:250:mount.lustre.0 Request processed in 241us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583212.376661:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787583212.376705:0:3652:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787583212.376713:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:0.0:1787583212.376720:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787583212.376725:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787583212.376728:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909247f16800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787583212.376731:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787583212.376750:0:3652:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787583212.376755:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea761437-c095-48a5-91f7-0c431111ca6a:3652:1874416435891840:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787583212.393253:0:17132:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787583212.393459:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787583212.393465:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787583212.397771:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787583212.397783:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787583212.398314:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787583212.398320:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787583212.402075:0:17132:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787583212.402246:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787583212.402252:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787583212.403098:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787583212.403107:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787583212.500586:0:17132:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787583212.500787:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787583212.500793:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787583212.505770:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787583212.505781:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787583212.506397:0:17132:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787583212.506562:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787583212.506568:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787583212.508219:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787583212.508231:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787583212.509027:0:17132:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787583212.509191:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787583212.509197:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787583212.509776:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787583212.509782:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787583212.510375:0:17132:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787583212.510507:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787583212.510512:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787583212.512012:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787583212.512022:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787583212.546575:0:17132:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787583212.546944:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787583212.546952:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787583212.552774:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787583212.552794:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787583212.553804:0:17132:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787583212.553813:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787583212.558119:0:17132:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787583212.558160:0:17132:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787583212.558165:0:17132:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787583212.558258:0:17132:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787583212.558296:0:17132:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787583212.558300:0:17132:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787583212.558302:0:17132:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787583212.558303:0:17132:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787583212.558304:0:17132:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787583212.558306:0:17132:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787583212.558307:0:17132:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787583212.558308:0:17132:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787583212.558310:0:17132:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787583212.558311:0:17132:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787583212.558313:0:17132:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787583212.558315:0:17132:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787583212.558317:0:17132:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787583212.558318:0:17132:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787583212.558320:0:17132:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787583212.558321:0:17132:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787583212.558322:0:17132:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787583212.558329:0:17132:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787583212.558330:0:17132:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787583212.558331:0:17132:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787583212.558332:0:17132:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787583212.558333:0:17132:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787583212.558357:0:17132:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787583212.558375:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435891968:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787583212.558440:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583212.558493:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a081f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787583212.558552:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435891968 00000100:00100000:0.0:1787583212.558561:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435891968 00000100:00100000:0.0:1787583212.558610:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787583212.558619:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+5:17132:x1874416435891968:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787583212.558667:0:17148:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787583212.558670:0:17148:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787583212.558672:0:17148:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787583212.559181:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787583212.561149:0:17148:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1787583212.571403:0:17170:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787583212.571411:0:17170:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787583212.571415:0:17170:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787583212.571417:0:17170:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787583212.571644:0:17170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787583212.571898:0:17148:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787583212.571909:0:17148:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787583212.573438:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+5:17132:x1874416435891968:12345-0@lo:253:mount.lustre.0 Request processed in 14811us (14988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583212.573456:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787583212.573543:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435891968:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787583212.573556:0:17132:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787583212.573560:0:17132:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787583212.573561:0:17132:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787583212.573563:0:17132:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787583212.573564:0:17132:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787583212.573565:0:17132:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787583212.573566:0:17132:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787583212.573568:0:17132:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787583212.573569:0:17132:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787583212.573570:0:17132:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787583212.573572:0:17132:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787583212.573589:0:17132:0:(tgt_mount.c:101:server_register_mount()) register mount ffff909248438000 from lustre-MDT0000 10000000:01000000:2.0:1787583212.573615:0:17132:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787583212.573617:0:17132:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787583212.573621:0:17132:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff909373fd99b8 10000000:01000000:2.0:1787583212.573626:0:17132:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787583212.573641:0:17132:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff909373fd99b8 from 1 10000000:01000000:2.0:1787583212.573643:0:17132:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787583212.573676:0:17132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583212.573687:0:17132:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583212.573697:0:17132:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583212.573715:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435892096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787583212.573759:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583212.573794:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d13180 going to sleep for 11 seconds 00000100:00100000:0.0:1787583212.573837:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435892096 00000100:00100000:0.0:1787583212.573842:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435892096 00000100:00100000:0.0:1787583212.573906:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787583212.573915:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+5:17132:x1874416435892096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583212.573927:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583212.573940:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713e600/0x19a47956376b7285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b727e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.573960:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713e600/0x19a47956376b7285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b727e expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.573970:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713e600/0x19a47956376b7285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b727e expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.573989:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e600, rc 0) 00000100:00100000:0.0:1787583212.574018:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+6:17132:x1874416435892096:12345-0@lo:101:mount.lustre.0 Request processed in 105us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583212.574035:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787583212.574189:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435892096:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787583212.574201:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583212.574210:0:17132:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583212.574264:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435892224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787583212.574289:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583212.574313:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d13180 going to sleep for 11 seconds 00000100:00100000:1.0:1787583212.574354:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435892224 00000100:00100000:1.0:1787583212.574357:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435892224 00000100:00100000:1.0:1787583212.574385:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787583212.574390:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+6:17132:x1874416435892224:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583212.574449:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+6:17132:x1874416435892224:12345-0@lo:501:mount.lustre.0 Request processed in 59us (159us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787583212.574455:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787583212.574525:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435892224:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787583212.574551:0:17132:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787583212.574562:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583212.574581:0:17132:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583212.574588:0:17132:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff909248438000 10000000:01000000:2.0:1787583212.574602:0:17132:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787583212.574607:0:17132:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff909248438000 10000000:01000000:2.0:1787583212.574609:0:17132:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787583212.574611:0:17132:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff909248438000 from 1 10000000:01000000:2.0:1787583212.574614:0:17132:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787583212.574629:0:17132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded600/0x19a47956376b728c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583212.574636:0:17132:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344ded600/0x19a47956376b728c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583212.574643:0:17132:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344ded600/0x19a47956376b728c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583212.574655:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435892352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787583212.574679:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583212.574776:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365d13180 going to sleep for 11 seconds 00000100:00100000:1.0:1787583212.578244:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435892352 00000100:00100000:1.0:1787583212.578258:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435892352 00000100:00100000:1.0:1787583212.578378:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787583212.578390:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+6:17132:x1874416435892352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787583212.578405:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583212.578426:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909247c53c00/0x19a47956376b7293 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b728c expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.578452:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909247c53c00/0x19a47956376b7293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b728c expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.578466:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909247c53c00/0x19a47956376b7293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b728c expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.578474:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c53c00, rc 0) 00000100:00100000:1.0:1787583212.578560:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+7:17132:x1874416435892352:12345-0@lo:101:mount.lustre.0 Request processed in 173us (3879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583212.578567:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787583212.578665:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435892352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787583212.578683:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344ded600/0x19a47956376b728c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7293 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583212.578693:0:17132:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344ded600/0x19a47956376b728c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7293 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583212.578710:0:17132:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787583212.578723:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded600/0x19a47956376b728c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7293 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583212.578731:0:17132:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344ded600/0x19a47956376b728c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7293 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583212.578751:0:17132:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787583212.578755:0:17132:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787583212.578761:0:17132:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff909248438000 10000000:01000000:3.0:1787583212.578763:0:17132:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787583212.578766:0:17132:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787583212.578769:0:17132:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787583212.578794:0:17132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909248497e00/0x19a47956376b729a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583212.578813:0:17132:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909248497e00/0x19a47956376b729a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583212.578822:0:17132:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909248497e00/0x19a47956376b729a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583212.578842:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435892480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787583212.578923:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583212.583245:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a081180 going to sleep for 11 seconds 00000100:00100000:2.0:1787583212.583306:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435892480 00000100:00100000:2.0:1787583212.583315:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435892480 00000100:00100000:2.0:1787583212.583359:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787583212.583368:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909355335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+7:17132:x1874416435892480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787583212.583382:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583212.583398:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344dec000/0x19a47956376b72a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b729a expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583212.583440:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344dec000/0x19a47956376b72a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b729a expref: 8 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583212.583451:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344dec000/0x19a47956376b72a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b729a expref: 8 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583212.583459:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dec000, rc 0) 00000100:00100000:2.0:1787583212.583565:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909355335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+8:17132:x1874416435892480:12345-0@lo:101:mount.lustre.0 Request processed in 197us (4641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583212.583572:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787583212.587276:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435892480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787583212.587305:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909248497e00/0x19a47956376b729a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b72a1 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583212.587317:0:17132:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909248497e00/0x19a47956376b729a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b72a1 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583212.587398:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435892608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583212.587456:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583212.587498:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a081180 going to sleep for 11 seconds 00000100:00100000:1.0:1787583212.587587:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435892608 00000100:00100000:1.0:1787583212.587593:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435892608 00000100:00100000:1.0:1787583212.587635:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787583212.587643:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909355335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+8:17132:x1874416435892608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583212.587785:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909355335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+9:17132:x1874416435892608:12345-0@lo:501:mount.lustre.0 Request processed in 142us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583212.587792:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787583212.587915:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435892608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583212.587958:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435892736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787583212.587993:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583212.588008:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a081180 going to sleep for 11 seconds 00000100:00100000:1.0:1787583212.588104:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435892736 00000100:00100000:1.0:1787583212.588109:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435892736 00000100:00100000:1.0:1787583212.588137:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787583212.588144:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+9:17132:x1874416435892736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787583212.588730:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+9:17132:x1874416435892736:12345-0@lo:503:mount.lustre.0 Request processed in 584us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583212.588765:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787583212.590185:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435892736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787583212.597097:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17171:1874416435892864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787583212.597184:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583212.597228:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0813c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583212.597333:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435892864 00000100:00100000:2.0:1787583212.597341:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435892864 00000100:00100000:2.0:1787583212.597388:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787583212.597398:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+9:17171:x1874416435892864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583212.598056:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+9:17171:x1874416435892864:12345-0@lo:502:llog_process_th.0 Request processed in 658us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583212.598065:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787583212.598255:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17171:1874416435892864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787583212.598285:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583212.598297:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.598299:0:17171:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787583212.598303:0:17171:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787583212.598306:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787583212.598319:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff909246794d28) 00000020:00000080:3.0:1787583212.598335:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787583212.598339:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787583212.598420:0:17171:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787583212.598427:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b72af 00000020:00000080:3.0:1787583212.598615:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787583212.598620:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583212.598623:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.598624:0:17171:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787583212.598626:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583212.598629:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.598631:0:17171:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787583212.598634:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787583212.598640:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff909246790000) 00000020:00000080:3.0:1787583212.598649:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787583212.598653:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787583212.598655:0:17171:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787583212.598657:0:17171:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787583212.598663:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787583212.598701:0:17171:0:(tgt_mount.c:153:server_get_mount()) get mount ffff909248438000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787583212.598713:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9092467919b8) 00000020:00000080:3.0:1787583212.598721:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787583212.598796:0:17171:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787583212.598807:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b72c4 00000020:00000080:3.0:1787583212.598934:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787583212.598940:0:17171:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787583212.598945:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x19a47956376b72cb 00080000:01000000:3.0:1787583212.598950:0:17171:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787583212.598953:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b72d2 00010000:00010000:3.0:1787583212.666415:0:17171:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787583212.666924:0:17171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1787583212.667237:0:17171:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787583212.667791:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff909246688000) 00000020:00000080:3.0:1787583212.667809:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787583212.667967:0:17171:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787583212.667975:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b72e0 00000020:00000080:3.0:1787583212.677092:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787583212.679670:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x19a47956376b72e7 00000020:00000080:3.0:1787583212.680046:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787583212.680057:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583212.680063:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.680064:0:17171:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787583212.680067:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787583212.680070:0:17171:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787583212.680071:0:17171:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787583212.680073:0:17171:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787583212.680074:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787583212.680076:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.680078:0:17171:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787583212.680080:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583212.680084:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.680085:0:17171:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787583212.680089:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787583212.680127:0:17171:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787583212.680140:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583212.680143:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.680150:0:17171:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787583212.680154:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583212.680157:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.680158:0:17171:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787583212.680161:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787583212.680166:0:17171:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:3.0:1787583212.680191:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787583212.680205:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff90924668cd28) 00000020:00000080:3.0:1787583212.680219:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787583212.680224:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787583212.680275:0:17171:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787583212.680281:0:17171:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787583212.680286:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b72f5 00010000:00080000:3.0:1787583212.680315:0:17171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909342bcd800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1787583212.682110:0:17171:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787583212.683411:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787583212.683496:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787583212.683536:0:17171:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787583212.683555:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b72fc 00000100:00080000:3.0:1787583212.683565:0:17171:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787583212.683572:0:17171:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff909342bcd800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787583212.683617:0:17171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc8aa00 x1874416435892992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787583212.683682:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435892992:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787583212.683758:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787583212.683915:0:17171:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787583212.683992:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583212.683996:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.683998:0:17171:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787583212.684001:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787583212.684004:0:17171:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1787583212.684005:0:17171:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787583212.684007:0:17171:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787583212.684015:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787583212.684017:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.684019:0:17171:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787583212.684021:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787583212.684036:0:17171:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787583212.684041:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.684042:0:17171:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787583212.684045:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787583212.684049:0:17171:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:3.0:1787583212.684069:0:17171:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787583212.684073:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787583212.684084:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90924668b370) 00000020:00000080:3.0:1787583212.684095:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787583212.684100:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787583212.684158:0:17171:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787583212.684163:0:17171:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787583212.684169:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b730a 00010000:00080000:3.0:1787583212.684199:0:17171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909245b04000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1787583212.684419:0:17171:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1787583212.685372:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435892992 00000100:00100000:1.0:1787583212.685381:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435892992 00000100:00100000:1.0:1787583212.685433:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787583212.685441:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874416435892992:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787583212.685459:0:17158:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1787583212.689899:0:17171:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787583212.690167:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787583212.691764:0:17171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787583212.692075:0:17171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787583212.692220:0:17171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787583212.707234:0:17177:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787583212.707243:0:17177:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:0.0:1787583212.710997:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909342bcd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787583212.711008:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787583212.711013:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435892992:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1787583212.711302:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787583212.711315:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787583212.711362:0:17171:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787583212.711382:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b7311 00000100:00080000:0.0:1787583212.711390:0:17171:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787583212.711396:0:17171:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff909245b04000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1787583212.711425:0:17171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247ef4a80 x1874416435893120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787583212.711453:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435893120:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787583212.711488:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416435893120 offset 0 length 520: 4 00000100:00080000:0.0:1787583212.711524:0:17171:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787583212.711582:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787583212.711587:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583212.711588:0:17171:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787583212.711592:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787583212.711594:0:17171:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1787583212.711608:0:17171:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787583212.711610:0:17171:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787583212.711612:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787583212.711616:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583212.711617:0:17171:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787583212.711620:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787583212.711623:0:17171:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787583212.711627:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583212.711629:0:17171:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787583212.711632:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787583212.711636:0:17171:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1787583212.711655:0:17171:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787583212.711658:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787583212.711669:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90937fbc19b8) 00000020:00000080:0.0:1787583212.711682:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1787583212.711687:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787583212.711769:0:17171:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787583212.711775:0:17171:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787583212.711783:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a47956376b731f 00010000:00080000:0.0:1787583212.711810:0:17171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909246692000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1787583212.712051:0:17171:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787583212.712116:0:17171:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787583212.712130:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787583212.713703:0:17171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787583212.713984:0:17171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787583212.714184:0:17171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787583212.716120:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787583212.716131:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1787583212.716179:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874416435892992:12345-0@lo:38:llog_process_th.0 Request processed in 25403us (27085us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787583212.716193:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:2.0:1787583212.722760:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787583212.722774:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787583212.722820:0:17171:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787583212.722839:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b7326 00000100:00080000:2.0:1787583212.722868:0:17171:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787583212.722875:0:17171:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff909246692000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583212.722910:0:17171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f83800 x1874416435893248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787583212.723121:0:17171:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787583212.723173:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787583212.723178:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583212.723180:0:17171:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787583212.723183:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787583212.723187:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583212.723188:0:17171:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787583212.723191:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787583212.723193:0:17171:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787583212.723196:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787583212.723198:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583212.723199:0:17171:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787583212.723202:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787583212.723204:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583212.723206:0:17171:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787583212.723209:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787583212.723252:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17171:1874416435893376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583212.723332:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583212.723338:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435893248:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787583212.723368:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a17240 going to sleep for 11 seconds 00000400:00000100:0.0:1787583212.723369:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416435893248 offset 0 length 520: 4 00000100:00100000:0.0:1787583212.723399:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435893376 00000100:00100000:0.0:1787583212.723406:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435893376 00000100:00100000:0.0:1787583212.723453:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787583212.723462:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+9:17171:x1874416435893376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787583212.723594:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+9:17171:x1874416435893376:12345-0@lo:502:llog_process_th.0 Request processed in 131us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583212.723602:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787583212.723700:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17171:1874416435893376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787583212.723724:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787583212.723729:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583212.723731:0:17171:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787583212.723743:0:17171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787583212.725244:0:17132:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787583212.725275:0:17132:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787583212.725328:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909248497e00/0x19a47956376b729a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b72a1 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583212.725340:0:17132:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909248497e00/0x19a47956376b729a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b72a1 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583212.725442:0:17132:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff909248438000 from 1 10000000:01000000:0.0:1787583212.725445:0:17132:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787583212.725484:0:17132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.725492:0:17132:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.725502:0:17132:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583212.725522:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435893504:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787583212.725572:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583212.725615:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff909373ead9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583212.725681:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435893504 00000100:00100000:1.0:1787583212.725688:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435893504 00000100:00100000:1.0:1787583212.725731:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787583212.725750:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+9:17132:x1874416435893504:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787583212.725761:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583212.725774:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909247c52c00/0x19a47956376b7334 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b732d expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.725796:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909247c52c00/0x19a47956376b7334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b732d expref: 10 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.725807:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909247c52c00/0x19a47956376b7334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b732d expref: 10 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.725815:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52c00, rc 0) 00000100:00100000:1.0:1787583212.725884:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+10:17132:x1874416435893504:12345-0@lo:101:mount.lustre.0 Request processed in 136us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583212.725890:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787583212.725991:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435893504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787583212.726005:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583212.726015:0:17132:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583212.726541:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435893632:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787583212.726581:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583212.726723:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0813c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583212.727073:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435893632 00000100:00100000:1.0:1787583212.727080:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435893632 00000100:00100000:1.0:1787583212.727298:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787583212.727309:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+10:17132:x1874416435893632:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787583212.727326:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787583212.727332:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787583212.727415:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+10:17132:x1874416435893632:12345-0@lo:256:mount.lustre.0 Request processed in 108us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583212.727632:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435893632:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787583212.728238:0:17132:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787583212.728254:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583212.728272:0:17132:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583212.728281:0:17132:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff909248438000 from 1 10000000:01000000:3.0:1787583212.728283:0:17132:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787583212.728312:0:17132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583212.728321:0:17132:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583212.728331:0:17132:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583212.728405:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435893760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787583212.728443:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583212.728467:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0813c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583212.728675:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435893760 00000100:00100000:0.0:1787583212.728682:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435893760 00000100:00100000:1.0:1787583212.728864:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787583212.729102:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787583212.729113:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+10:17132:x1874416435893760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583212.729124:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583212.729136:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713f800/0x19a47956376b7342 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b733b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.729158:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713f800/0x19a47956376b7342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b733b expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.729168:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713f800/0x19a47956376b7342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b733b expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.729185:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f800, rc 0) 00000100:00100000:0.0:1787583212.729277:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+11:17132:x1874416435893760:12345-0@lo:101:mount.lustre.0 Request processed in 167us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583212.729285:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787583212.729361:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435893760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787583212.729375:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7342 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583212.729383:0:17132:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7342 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583212.729446:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435893888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583212.729472:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583212.729499:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0813c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583212.729548:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435893888 00000100:00100000:1.0:1787583212.729552:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435893888 00000100:00100000:1.0:1787583212.729582:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787583212.729590:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d914850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+11:17132:x1874416435893888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583212.729719:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d914850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+11:17132:x1874416435893888:12345-0@lo:501:mount.lustre.0 Request processed in 129us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583212.729726:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787583212.729835:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435893888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583212.729891:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435894016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787583212.729934:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583212.729953:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a0813c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583212.730097:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435894016 00000100:00100000:1.0:1787583212.730101:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435894016 00000100:00100000:1.0:1787583212.730132:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787583212.730139:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d915850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+11:17132:x1874416435894016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787583212.730232:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d915850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+11:17132:x1874416435894016:12345-0@lo:503:mount.lustre.0 Request processed in 94us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583212.730240:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787583212.730339:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435894016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787583212.730680:0:17181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17181:1874416435894144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787583212.730717:0:17181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583212.730754:0:17181:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a081180 going to sleep for 11 seconds 00000100:00100000:1.0:1787583212.730804:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435894144 00000100:00100000:1.0:1787583212.730809:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435894144 00000100:00100000:1.0:1787583212.730892:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787583212.730900:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+11:17181:x1874416435894144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787583212.731363:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+11:17181:x1874416435894144:12345-0@lo:502:llog_process_th.0 Request processed in 462us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583212.731370:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787583212.731455:0:17181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17181:1874416435894144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787583212.731481:0:17181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583212.731494:0:17181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.731497:0:17181:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787583212.731504:0:17181:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff909248438000 00000020:00000080:3.0:1787583212.731507:0:17181:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787583212.731516:0:17181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583212.731519:0:17181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.731521:0:17181:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787583212.731523:0:17181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583212.731526:0:17181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.731527:0:17181:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787583212.731530:0:17181:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff909248438000 00000020:00000080:3.0:1787583212.731533:0:17181:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787583212.731585:0:17181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583212.731589:0:17181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.731590:0:17181:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787583212.731594:0:17181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583212.731596:0:17181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.731597:0:17181:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787583212.731601:0:17181:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff909248438000 00000020:00000080:3.0:1787583212.731603:0:17181:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787583212.731619:0:17181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583212.731622:0:17181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.731624:0:17181:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787583212.731626:0:17181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583212.731628:0:17181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.731629:0:17181:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787583212.731632:0:17181:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff909248438000 00000020:00000080:3.0:1787583212.731634:0:17181:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787583212.731664:0:17181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17181:1874416435894272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787583212.731701:0:17181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583212.731722:0:17181:0:(client.c:2715:ptlrpc_set_wait()) set ffff909358ab3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787583212.731785:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435894272 00000100:00100000:1.0:1787583212.731790:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435894272 00000100:00100000:1.0:1787583212.731810:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787583212.731816:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d917450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+11:17181:x1874416435894272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787583212.731919:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d917450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+11:17181:x1874416435894272:12345-0@lo:502:llog_process_th.0 Request processed in 102us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583212.731926:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787583212.733405:0:17181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17181:1874416435894272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787583212.733448:0:17181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583212.733455:0:17181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583212.733458:0:17181:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787583212.733462:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787583212.733634:0:17132:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787583212.733655:0:17132:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787583212.733681:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7342 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.733693:0:17132:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7342 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583212.733756:0:17132:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787583212.733759:0:17132:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff909248438000 10000000:01000000:0.0:1787583212.733762:0:17132:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff909248438000 10000000:01000000:0.0:1787583212.733767:0:17132:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787583212.733772:0:17132:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff909248438000 from 1 10000000:01000000:0.0:1787583212.733775:0:17132:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787583212.733803:0:17132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713fe00/0x19a47956376b7349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.733811:0:17132:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924713fe00/0x19a47956376b7349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.733820:0:17132:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924713fe00/0x19a47956376b7349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583212.733837:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435894400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787583212.733935:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583212.733969:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff909373eadcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583212.737215:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435894400 00000100:00100000:0.0:1787583212.737230:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435894400 00000100:00100000:0.0:1787583212.737284:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787583212.737294:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d917c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+11:17132:x1874416435894400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583212.737310:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583212.737326:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713e200/0x19a47956376b7350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b7349 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.737351:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713e200/0x19a47956376b7350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b7349 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.737361:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713e200/0x19a47956376b7350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7349 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.737370:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e200, rc 0) 00000100:00100000:0.0:1787583212.737441:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d917c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:17132:x1874416435894400:12345-0@lo:101:mount.lustre.0 Request processed in 149us (3505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583212.737449:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787583212.737506:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435894400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583212.737525:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924713fe00/0x19a47956376b7349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7350 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.737534:0:17132:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924713fe00/0x19a47956376b7349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7350 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583212.737621:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435894528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787583212.737659:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583212.737686:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff909373eadcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583212.737701:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435894528 00000100:00100000:0.0:1787583212.737704:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435894528 00000100:00100000:0.0:1787583212.737724:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787583212.737730:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:17132:x1874416435894528:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787583212.737867:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:17132:x1874416435894528:12345-0@lo:501:mount.lustre.0 Request processed in 136us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583212.737874:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787583212.737911:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435894528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787583212.737936:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435894656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787583212.737977:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583212.737990:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff909373eadcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583212.738002:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435894656 00000100:00100000:0.0:1787583212.738006:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435894656 00000100:00100000:0.0:1787583212.738221:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787583212.738230:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:17132:x1874416435894656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787583212.738311:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:17132:x1874416435894656:12345-0@lo:503:mount.lustre.0 Request processed in 82us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583212.738319:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787583212.738359:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435894656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787583212.739392:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17183:1874416435894784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583212.739443:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583212.739478:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a17240 going to sleep for 11 seconds 00000100:00100000:0.0:1787583212.739529:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435894784 00000100:00100000:0.0:1787583212.739534:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435894784 00000100:00100000:0.0:1787583212.739563:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787583212.739572:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d915c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:17183:x1874416435894784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787583212.739683:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d915c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:17183:x1874416435894784:12345-0@lo:502:llog_process_th.0 Request processed in 112us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583212.739690:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787583212.739776:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17183:1874416435894784:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787583212.739832:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787583212.739872:0:17183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9092464c99b8) 00000020:00000080:2.0:1787583212.739891:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787583212.739963:0:17183:0:(tgt_mount.c:153:server_get_mount()) get mount ffff909248438000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787583212.739967:0:17183:0:(tgt_mount.c:187:server_put_mount()) put mount ffff909248438000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787583212.739970:0:17183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff909248438000 4 00010000:00080000:2.0:1787583212.739998:0:17183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9092471bd000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1787583212.747414:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1787583212.747772:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787583212.747810:0:17183:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787583212.747823:0:17183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x19a47956376b735e 00000100:00080000:2.0:1787583212.747832:0:17183:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787583212.747838:0:17183:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9092471bd000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583212.747891:0:17183:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f82d80 x1874416435894912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787583212.747923:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874416435894912:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787583212.748001:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583212.748039:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435894912 00000100:00100000:1.0:1787583212.748047:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435894912 00000100:00080000:2.0:1787583212.748062:0:17183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787583212.748079:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787583212.748087:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874416435894912:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787583212.748151:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874416435894912:12345-0@lo:38:llog_process_th.0 Request processed in 63us (148us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787583212.748159:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787583212.748196:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787583212.748204:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9092471bd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787583212.748208:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787583212.748211:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874416435894912:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787583212.749400:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17183:1874416435895040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583212.749477:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583212.749514:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435895040 00000100:00100000:2.0:1787583212.749520:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435895040 00000100:00100000:2.0:1787583212.749570:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787583212.749578:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+12:17183:x1874416435895040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583212.749690:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+12:17183:x1874416435895040:12345-0@lo:502:llog_process_th.0 Request processed in 112us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583212.749698:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787583212.749750:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a17780 going to sleep for 11 seconds 00000100:00100000:2.0:1787583212.749768:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17183:1874416435895040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583212.749804:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17183:1874416435895168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787583212.749836:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583212.749875:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a17780 going to sleep for 11 seconds 00000100:00100000:0.0:1787583212.750258:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435895168 00000100:00100000:0.0:1787583212.750263:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435895168 00000100:00100000:0.0:1787583212.750340:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787583212.750348:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d915050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:17183:x1874416435895168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787583212.750508:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d915050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:17183:x1874416435895168:12345-0@lo:502:llog_process_th.0 Request processed in 160us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583212.750517:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787583212.754276:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea761437-c095-48a5-91f7-0c431111ca6a:17183:1874416435895168:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787583212.754319:0:17183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787583212.754557:0:17132:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787583212.754583:0:17132:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787583212.754639:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713fe00/0x19a47956376b7349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7350 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.754650:0:17132:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924713fe00/0x19a47956376b7349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7350 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787583212.754705:0:17132:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787583212.754707:0:17132:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787583212.754708:0:17132:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787583212.754709:0:17132:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787583212.754711:0:17132:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787583212.754712:0:17132:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787583212.754714:0:17132:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787583212.754715:0:17132:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787583212.754717:0:17132:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787583212.754718:0:17132:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787583212.754722:0:17132:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787583212.754725:0:17132:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787583212.754726:0:17132:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787583212.754731:0:17132:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787583212.754743:0:17132:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787583212.754745:0:17132:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787583212.754746:0:17132:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787583212.754747:0:17132:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787583212.754748:0:17132:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787583212.754749:0:17132:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787583212.754750:0:17132:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787583212.754773:0:17132:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787583212.754788:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435895296:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787583212.754864:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583212.754888:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff909373ead0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583212.755117:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435895296 00000100:00100000:2.0:1787583212.755124:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435895296 00000100:00100000:2.0:1787583212.755201:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787583212.755211:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+12:17132:x1874416435895296:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787583212.755234:0:17148:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787583212.755245:0:17148:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787583212.759266:0:17148:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787583212.759287:0:17148:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787583212.759708:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+12:17132:x1874416435895296:12345-0@lo:253:mount.lustre.0 Request processed in 4494us (4839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583212.759720:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787583212.760019:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17132:1874416435895296:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787583212.760095:0:17132:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787583212.760110:0:17132:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787583212.760112:0:17132:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787583212.760113:0:17132:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787583212.760115:0:17132:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787583212.760116:0:17132:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787583212.760117:0:17132:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787583212.760119:0:17132:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787583212.760121:0:17132:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787583212.760123:0:17132:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787583212.760124:0:17132:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787583212.760139:0:17132:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787583212.760666:0:17169:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787583212.760671:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787583212.760692:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.760709:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909247c52c00/0x19a47956376b7334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b732d expref: 11 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.760718:0:17169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.760777:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909247c52c00/0x19a47956376b7334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b732d expref: 11 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.760792:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff909247c52c00/0x19a47956376b7334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b732d expref: 11 pid: 17148 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583212.760806:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435895424:0@lo:104: 00000100:00100000:1.0:1787583212.760865:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583212.760902:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7540 going to sleep for 11 seconds 00000100:00100000:0.0:1787583212.761566:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435895424 00000100:00100000:0.0:1787583212.761575:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435895424 00000100:00100000:0.0:1787583212.761623:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787583212.761632:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+3:17169:x1874416435895424:12345-0@lo:104: 00010000:00010000:0.0:1787583212.761646:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b7334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.761701:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787583212.761707:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+3:17169:x1874416435895424:12345-0@lo:104: Request processed in 76us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583212.761714:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787583212.761931:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435895424:0@lo:104: 00010000:00010000:0.0:1787583212.761964:0:17169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.762119:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787583212.762126:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b7334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.762134:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fa00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787583212.762139:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b7334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.762147:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b7334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787583212.762154:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b7334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583212.762160:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787583212.762192:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.762199:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787583212.762228:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.762246:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b732d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583212.762264:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583212.762266:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583212.762267:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583212.762320:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435895552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583212.762356:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583212.767240:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435895552 00000100:00100000:0.0:1787583212.767256:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435895552 00010000:00010000:0.0:1787583212.767291:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909247c52c00/0x19a47956376b7334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b732d expref: 12 pid: 17148 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583212.767364:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787583212.767375:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea761437-c095-48a5-91f7-0c431111ca6a+12:3656:x1874416435895552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787583212.767389:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583212.767395:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909247c52c00/0x19a47956376b7334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b732d expref: 12 pid: 17148 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767407:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909247c52c00/0x19a47956376b7334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b732d expref: 12 pid: 17148 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767438:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909247c52c00/0x19a47956376b7334 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b732d expref: 12 pid: 17148 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767454:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767462:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787583212.767477:0:17138:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006806161s 00010000:00010000:0.0:1787583212.767481:0:17138:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767489:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767495:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767501:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767513:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52600 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583212.767518:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767526:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767540:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767550:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787583212.767621:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea761437-c095-48a5-91f7-0c431111ca6a+11:3656:x1874416435895552:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (5265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583212.767629:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787583212.767659:0:17169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767667:0:17169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583212.767674:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909247c52600/0x19a47956376b7365 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583212.768773:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435895552:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787583212.780953:0:17132:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787583212.784813:0:17132:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787583212.784903:0:17192:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787583212.784908:0:17192:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787583212.787964:0:17194:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787583212.788160:0:17132:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1787583212.789570:0:17194:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1787583212.789596:0:17195:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff909348843b80 x1874416435895680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583212.789609:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00000040:01000000:3.0:1787583212.790417:0:17132:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787583212.790463:0:17132:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787583212.790898:0:17132:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787583212.790907:0:17132:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787583212.790942:0:17132:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787583212.796812:0:17194:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787583212.796920:0:17194:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1787583212.800943:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787583212.801509:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787583212.801543:0:17132:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787583212.803874:0:17132:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1787583212.808542:0:17132:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787583212.824173:0:17132:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787583212.824209:0:17132:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3cd40e33988 00100000:10000000:3.0:1787583212.824217:0:17132:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787583212.830118:0:17132:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787583212.830136:0:17132:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787583212.830154:0:17132:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787583212.830180:0:17132:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787583212.840787:0:17132:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787583212.842583:0:17132:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787583213.390212:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787583213.711496:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787583213.711504:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff909248438000 from 7 10000000:01000000:0.0:1787583213.711511:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787583213.711555:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583213.711568:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583213.711586:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583213.711611:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435895808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787583213.711675:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583213.711735:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a36180 going to sleep for 11 seconds 00000100:00100000:1.0:1787583213.711783:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435895808 00000100:00100000:1.0:1787583213.711792:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435895808 00000100:00100000:1.0:1787583213.711952:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787583213.711964:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d916450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+11:17151:x1874416435895808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583213.711978:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583213.711991:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909247c52e00/0x19a47956376b7373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b736c expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583213.712013:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909247c52e00/0x19a47956376b7373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b736c expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583213.712469:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909247c52e00/0x19a47956376b7373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b736c expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583213.712490:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52e00, rc 0) 00000100:00100000:1.0:1787583213.712552:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d916450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+12:17151:x1874416435895808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 591us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583213.712560:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787583213.713090:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435895808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787583213.713111:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7373 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583213.713121:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7373 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583213.713181:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435895936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787583213.713221:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583213.713255:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a36180 going to sleep for 11 seconds 00000100:00100000:3.0:1787583213.714140:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435895936 00000100:00100000:3.0:1787583213.714150:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435895936 00000100:00100000:3.0:1787583213.714197:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787583213.714207:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+12:17151:x1874416435895936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787583213.714227:0:17148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787583213.714242:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787583213.714244:0:17148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787583213.714483:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+12:17151:x1874416435895936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 277us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583213.714498:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787583213.714676:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435895936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787583213.714722:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787583213.714740:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7373 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583213.714750:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7373 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787583213.840442:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787583213.842127:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00010000:00010000:1.0:1787583214.414624:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787583214.862560:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787583214.876774:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00010000:00010000:1.0:1787583215.439178:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583215.887124:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00010000:00010000:1.0:1787583216.463084:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583216.919524:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00010000:00010000:0.0:1787583217.497327:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787583217.505258:0:17438:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787583217.934047:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00000100:00080000:2.0:1787583218.128790:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787583218.128799:0:15041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787583218.128802:0:15041:0:(import.c:65:import_set_state_nolock()) ffff909342bcd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787583218.128810:0:15041:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1787583218.128816:0:15041:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787583218.128823:0:15041:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff909342bcd800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583218.128875:0:15041:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f83b80 x1874416435896192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787583218.128887:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787583218.128891:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787583218.128893:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787583218.128910:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787583218.128912:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787583218.128915:0:15041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787583218.128916:0:15041:0:(import.c:65:import_set_state_nolock()) ffff9092471bd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787583218.128921:0:15041:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9092471bd000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583218.128933:0:15041:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f80a80 x1874416435896320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787583218.128980:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435896064:0@lo:400:kworker.0 00000100:00100000:2.0:1787583218.129052:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583218.129143:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435896064 00000100:00100000:2.0:1787583218.129151:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435896064 00000100:00100000:2.0:1787583218.129189:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787583218.129197:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+12:3653:x1874416435896064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583218.129242:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+12:3653:x1874416435896064:12345-0@lo:400:kworker.0 Request processed in 46us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583218.129248:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787583218.129360:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435896064:0@lo:400:kworker.0 00000100:00100000:3.0:1787583218.129466:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435896192:0@lo:38:kworker.0 00000100:00100000:3.0:1787583218.129502:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583218.129529:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874416435896320:0@lo:38:kworker.0 00000100:00100000:3.0:1787583218.129556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583218.132074:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435896192 00000100:00100000:2.0:1787583218.132089:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435896192 00000100:00100000:2.0:1787583218.132130:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787583218.132139:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874416435896192:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787583218.132160:0:17159:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787583218.137981:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435896320 00000100:00100000:1.0:1787583218.137998:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435896320 00000100:00100000:1.0:1787583218.138043:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787583218.138052:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874416435896320:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787583218.138080:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:1.0:1787583218.138115:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x19a47956376b737a 00000004:00100000:1.0:1787583218.138130:0:17155:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787583218.138270:0:17155:0:(import.c:65:import_set_state_nolock()) ffff90936f235000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787583218.138365:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874416435896320:12345-0@lo:38:kworker.0 Request processed in 313us (8807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583218.138373:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787583218.138427:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff909247f80a80 x1874416435896320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787583228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787583218.138442:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787583218.138449:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787583218.138454:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787583218.138456:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9092471bd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787583218.138462:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874416435896320:0@lo:38:kworker.0 00000100:00100000:2.0:1787583218.154744:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874416435896192:12345-0@lo:38:kworker.0 Request processed in 22599us (25234us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787583218.154775:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787583218.158365:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909342bcd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787583218.158377:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787583218.158383:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435896192:0@lo:38:kworker.0 00000020:00000004:0.0:1787583218.472946:0:17490:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787583218.474192:0:17490:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787583218.510935:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583218.975753:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00000020:00000004:0.0:1787583219.409949:0:17540:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787583219.410170:0:17540:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787583219.542377:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583219.981966:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00010000:00010000:1.0:1787583220.559328:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583221.008532:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00010000:00010000:1.0:1787583221.582545:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583222.032911:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00000100:00100000:1.0:1787583222.223293:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583212/real 1787583212] req@ffff909247f83800 x1874416435893248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583222.223324:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff909247f83800 x1874416435893248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583222.223335:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583212/real 1787583212] req@ffff909247ef4a80 x1874416435893120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583222.223347:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff909247ef4a80 x1874416435893120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787583222.223380:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909246692000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787583222.223406:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787583222.223411:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435893248:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787583222.224206:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909245b04000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787583222.224216:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787583222.224221:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435893120:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787583222.224342:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787583222.224346:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787583222.224349:0:36:0:(import.c:65:import_set_state_nolock()) ffff909342bcd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787583222.224354:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 525 00000100:00080000:2.0:1787583222.224359:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787583222.224365:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff909342bcd800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583222.224387:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f82d80 x1874416435896576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787583222.224401:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787583222.224404:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787583222.224406:0:36:0:(import.c:65:import_set_state_nolock()) ffff909245b04000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787583222.224408:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1787583222.224411:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787583222.224486:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff909245b04000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583222.224500:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f81c00 x1874416435896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787583222.224509:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787583222.224512:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787583222.224514:0:36:0:(import.c:65:import_set_state_nolock()) ffff909246692000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787583222.224516:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1787583222.224525:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787583222.224528:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff909246692000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583222.224538:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f80e00 x1874416435896832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787583222.224660:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583222.224682:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435896448:0@lo:400:kworker.0 00000100:00100000:0.0:1787583222.224746:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583222.224804:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435896960:0@lo:400:kworker.0 00000100:00100000:0.0:1787583222.224882:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583222.224928:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435896960 00000100:00100000:0.0:1787583222.224935:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435896960 00000100:00100000:0.0:1787583222.224972:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787583222.224980:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435896960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583222.225099:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435896576:0@lo:38:kworker.0 00000100:00100000:1.0:1787583222.225134:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583222.225155:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435896704:0@lo:8:kworker.0 00000400:00000100:1.0:1787583222.225173:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416435896704 offset 0 length 520: 4 00000100:00100000:1.0:1787583222.225184:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435896832:0@lo:8:kworker.0 00000400:00000100:1.0:1787583222.225203:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416435896832 offset 0 length 520: 4 00000100:00100000:1.0:1787583222.225224:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435896576 00000100:00100000:1.0:1787583222.225228:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435896576 00000100:00100000:1.0:1787583222.225250:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787583222.225255:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874416435896576:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787583222.225271:0:17158:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787583222.225523:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435896448 00000100:00100000:2.0:1787583222.225528:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435896448 00000100:00100000:2.0:1787583222.225560:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787583222.225567:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:3653:x1874416435896448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583222.225617:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:3653:x1874416435896448:12345-0@lo:400:kworker.0 Request processed in 50us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583222.225623:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787583222.226556:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435896960:12345-0@lo:400:kworker.0 Request processed in 1572us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583222.226566:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787583222.226611:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435896448:0@lo:400:kworker.0 00010000:00080000:2.0:1787583222.228899:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff909247f83800 x1874416435896960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583222.228918:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435896960:0@lo:400:kworker.0 00000100:00100000:1.0:1787583222.266113:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874416435896576:12345-0@lo:38:kworker.0 Request processed in 40848us (40970us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787583222.266128:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787583222.266946:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909342bcd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787583222.266963:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787583222.266968:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435896576:0@lo:38:kworker.0 00010000:00010000:1.0:1787583222.606291:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583223.054139:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00010000:00010000:1.0:1787583223.636931:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583224.077933:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00000040:00080000:1.0:1787583224.083931:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787583224.656191:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583225.103772:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00010000:00010000:2.0:1787583225.680096:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787583225.704748:0:17885:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787583225.704752:0:17885:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787583225.704754:0:17885:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787583225.705149:0:17885:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90935822f800 00000020:01000004:0.0:1787583225.705166:0:17885:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787583225.705176:0:17885:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787583225.705190:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff90937fbc3370) 00000020:00000080:0.0:1787583225.705203:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787583225.784147:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787583225.786631:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787583225.791887:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.793828:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787583225.794277:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.794473:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787583225.794722:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.796134:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.796702:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.797690:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.799126:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787583225.799525:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.799915:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.803553:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.803909:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.804202:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787583225.804448:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787583225.804703:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787583225.805033:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.805301:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.805499:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787583225.805710:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787583225.806015:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787583225.806213:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787583225.806513:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1787583225.808489:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787583225.809481:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787583225.809780:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787583225.810097:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1787583225.810336:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787583225.810715:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787583225.811041:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787583225.811296:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787583225.811540:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787583225.812165:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787583225.812772:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787583225.813246:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787583225.815483:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787583225.818269:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787583225.818664:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787583225.819090:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787583225.819299:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787583225.819507:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787583225.819713:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787583225.821821:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787583225.822546:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:01000000:0.0:1787583225.826310:0:17885:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787583225.826532:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787583225.826545:0:17885:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787583225.826557:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x19a47956376b7388 00000020:01000004:0.0:1787583225.826563:0:17885:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787583225.826583:0:17885:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787583225.826586:0:17885:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787583225.826592:0:17885:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787583225.826630:0:17885:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787583225.826634:0:17885:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787583225.830260:0:17885:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787583225.830301:0:17885:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1787583225.830306:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787583225.830308:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787583225.830310:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787583225.830311:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787583225.830312:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787583225.830313:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787583225.830315:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787583225.830317:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787583225.830318:0:17885:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787583225.830322:0:17885:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1787583225.830324:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787583225.830325:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787583225.830327:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787583225.830327:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787583225.830329:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787583225.830330:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787583225.830331:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787583225.830332:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787583225.830333:0:17885:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787583225.830360:0:17885:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787583225.830380:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897088:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787583225.830446:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583225.830554:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909373eadb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787583225.830632:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435897088 00000100:00100000:2.0:1787583225.830640:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435897088 00000100:00100000:2.0:1787583225.830734:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787583225.830743:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+12:17885:x1874416435897088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787583225.830770:0:17148:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787583225.830773:0:17148:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1787583225.830779:0:17148:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787583225.831131:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+12:17885:x1874416435897088:12345-0@lo:253:mount.lustre.0 Request processed in 389us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583225.831139:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787583225.831223:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897088:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787583225.831233:0:17885:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787583225.831235:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787583225.831237:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787583225.831238:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787583225.831239:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787583225.831240:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787583225.831241:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787583225.831243:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787583225.831244:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787583225.831245:0:17885:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787583225.831260:0:17885:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90935822f800 from lustre-MDT0001 10000000:01000000:1.0:1787583225.831292:0:17885:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787583225.831294:0:17885:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787583225.831302:0:17885:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff909373fd99b8 local copy 00010000:00010000:1.0:1787583225.831312:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583225.831390:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583225.831419:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583225.831567:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a360c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583225.831665:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435897216 00000100:00100000:0.0:1787583225.831672:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435897216 00000100:00100000:0.0:1787583225.831699:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787583225.831707:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:17885:x1874416435897216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787583225.831785:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:17885:x1874416435897216:12345-0@lo:501:mount.lustre.0 Request processed in 78us (365us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787583225.831792:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787583225.831879:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897216:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787583225.831891:0:17885:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787583225.831905:0:17885:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787583225.831910:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.831919:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583225.831950:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90935822f800 10000000:01000000:1.0:1787583225.831958:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787583225.831963:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff909373fd99b8 10000000:01000000:1.0:1787583225.831965:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787583225.831968:0:17885:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff909373fd99b8 from 1 10000000:01000000:1.0:1787583225.831971:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787583225.831991:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c53800/0x19a47956376b738f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.831999:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909247c53800/0x19a47956376b738f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.832006:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909247c53800/0x19a47956376b738f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583225.832017:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787583225.832041:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583225.832055:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a360c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583225.832111:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435897344 00000100:00100000:0.0:1787583225.832115:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435897344 00000100:00100000:0.0:1787583225.832131:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787583225.832136:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+12:17885:x1874416435897344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583225.832144:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583225.832154:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713ee00/0x19a47956376b7396 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b738f expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.832173:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713ee00/0x19a47956376b7396 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b738f expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.832181:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713ee00/0x19a47956376b7396 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b738f expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.832189:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713ee00, rc 0) 00000100:00100000:0.0:1787583225.832224:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+13:17885:x1874416435897344:12345-0@lo:101:mount.lustre.0 Request processed in 88us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583225.832230:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787583225.832386:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787583225.832397:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909247c53800/0x19a47956376b738f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7396 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.832406:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909247c53800/0x19a47956376b738f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7396 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583225.832418:0:17885:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787583225.832433:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c53800/0x19a47956376b738f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7396 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.832440:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909247c53800/0x19a47956376b738f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7396 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583225.832457:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90935822f800 10000000:01000000:1.0:1787583225.832460:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787583225.832463:0:17885:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90935822f800 from 1 10000000:01000000:1.0:1787583225.832465:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787583225.832478:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c52a00/0x19a47956376b739d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.832485:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909247c52a00/0x19a47956376b739d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.832492:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909247c52a00/0x19a47956376b739d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583225.832502:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787583225.832525:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583225.832542:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a360c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583225.832590:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435897472 00000100:00100000:0.0:1787583225.832594:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435897472 00000100:00100000:0.0:1787583225.832611:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787583225.832616:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+13:17885:x1874416435897472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583225.832623:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583225.832630:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713e400/0x19a47956376b73a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b739d expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.832654:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713e400/0x19a47956376b73a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b739d expref: 14 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.832662:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713e400/0x19a47956376b73a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b739d expref: 14 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.832674:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e400, rc 0) 00000100:00100000:0.0:1787583225.832711:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+14:17885:x1874416435897472:12345-0@lo:101:mount.lustre.0 Request processed in 94us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583225.832716:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787583225.832921:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787583225.832941:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909247c52a00/0x19a47956376b739d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b73a4 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.832949:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909247c52a00/0x19a47956376b739d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b73a4 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583225.832959:0:17885:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787583225.832965:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c52a00/0x19a47956376b739d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b73a4 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.832972:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909247c52a00/0x19a47956376b739d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b73a4 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583225.832984:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787583225.832987:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787583225.832991:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90935822f800 10000000:01000000:1.0:1787583225.832994:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787583225.832996:0:17885:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787583225.832998:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787583225.833011:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c52400/0x19a47956376b73ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.833017:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909247c52400/0x19a47956376b73ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.833024:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909247c52400/0x19a47956376b73ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583225.833036:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787583225.833065:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583225.833075:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583225.833098:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435897600 00000100:00100000:2.0:1787583225.833105:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435897600 00000100:00100000:1.0:1787583225.833203:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787583225.833210:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+14:17885:x1874416435897600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787583225.833217:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583225.833224:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909247c52200/0x19a47956376b73b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b73ab expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.833236:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909247c52200/0x19a47956376b73b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b73ab expref: 15 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.833244:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909247c52200/0x19a47956376b73b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b73ab expref: 15 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.833256:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52200, rc 0) 00000100:00100000:1.0:1787583225.833289:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+15:17885:x1874416435897600:12345-0@lo:101:mount.lustre.0 Request processed in 79us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583225.833295:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787583225.833325:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787583225.833340:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909247c52400/0x19a47956376b73ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b73b2 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583225.833351:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909247c52400/0x19a47956376b73ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b73b2 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787583225.834724:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1787583225.835500:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787583225.838962:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787583225.839013:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1787583225.839028:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1787583225.839038:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1787583225.839050:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1787583225.839063:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1787583225.839074:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1787583225.839085:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1787583225.839097:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1787583225.839109:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1787583225.839120:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1787583225.839134:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1787583225.839151:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1787583225.839166:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1787583225.839179:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1787583225.839193:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1787583225.839205:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1787583225.839218:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1787583225.839230:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1787583225.839242:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1787583225.839255:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1787583225.839268:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787583225.839280:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787583225.839306:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1787583225.839320:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1787583225.839422:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583225.839486:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583225.839543:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a36180 going to sleep for 11 seconds 00000100:00100000:3.0:1787583225.839729:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435897728 00000100:00100000:3.0:1787583225.839738:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435897728 00000100:00100000:3.0:1787583225.839790:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787583225.839799:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+15:17885:x1874416435897728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583225.839969:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+15:17885:x1874416435897728:12345-0@lo:501:mount.lustre.0 Request processed in 171us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583225.839978:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787583225.840190:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583225.840224:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787583225.840267:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583225.840292:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a36180 going to sleep for 11 seconds 00000100:00100000:3.0:1787583225.840338:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435897856 00000100:00100000:3.0:1787583225.840343:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435897856 00000100:00100000:3.0:1787583225.840406:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787583225.840414:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+15:17885:x1874416435897856:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787583225.841199:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+15:17885:x1874416435897856:12345-0@lo:503:mount.lustre.0 Request processed in 782us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583225.841208:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787583225.841297:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897856:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787583225.841683:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787583225.841748:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787583225.841788:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583225.841825:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583225.841902:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435897984 00000100:00100000:2.0:1787583225.841908:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435897984 00000100:00100000:2.0:1787583225.841948:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787583225.841955:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+15:17885:x1874416435897984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787583225.842612:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+15:17885:x1874416435897984:12345-0@lo:502:mount.lustre.0 Request processed in 655us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583225.842621:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787583225.842792:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435897984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787583225.843144:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787583225.843175:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1787583225.843193:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1787583225.843207:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1787583225.843223:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1787583225.843236:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1787583225.843250:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1787583225.843263:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1787583225.843275:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1787583225.843289:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1787583225.843305:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1787583225.843321:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1787583225.843335:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1787583225.843359:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1787583225.843375:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1787583225.843388:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1787583225.843401:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1787583225.843416:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1787583225.843435:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1787583225.843449:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1787583225.843463:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1787583225.843477:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1787583225.843490:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1787583225.843505:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1787583225.843519:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1787583225.843531:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1787583225.843546:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1787583225.843559:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1787583225.843574:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1787583225.843586:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1787583225.843599:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1787583225.843611:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1787583225.843625:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1787583225.843638:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1787583225.843667:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1787583225.843682:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1787583225.843694:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1787583225.843707:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1787583225.843720:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1787583225.843734:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1787583225.843747:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1787583225.843760:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1787583225.843774:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1787583225.843790:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1787583225.843824:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435898112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787583225.844030:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583225.844114:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583225.844153:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435898112 00000100:00100000:3.0:1787583225.844159:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435898112 00000100:00100000:3.0:1787583225.844224:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787583225.844234:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+15:17885:x1874416435898112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583225.844346:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+15:17885:x1874416435898112:12345-0@lo:502:mount.lustre.0 Request processed in 113us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583225.844362:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787583225.844437:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435898112:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787583225.844491:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1787583225.844501:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1787583225.845227:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787583225.845237:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583225.845239:0:17889:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787583225.845244:0:17889:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787583225.845248:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787583225.845262:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9092464ccd28) 00000020:00000080:2.0:1787583225.845281:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1787583225.845286:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787583225.845377:0:17889:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787583225.845384:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x19a47956376b73c0 00000020:00000080:2.0:1787583225.845565:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787583225.845568:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787583225.845576:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583225.845578:0:17889:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787583225.845580:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787583225.845583:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583225.845584:0:17889:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787583225.845588:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787583225.845595:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9092464cb370) 00000020:00000080:2.0:1787583225.845606:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1787583225.845611:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787583225.845612:0:17889:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787583225.845615:0:17889:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787583225.845621:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787583225.845681:0:17889:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90935822f800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787583225.845692:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9092464c8000) 00000020:00000080:2.0:1787583225.845703:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1787583225.845782:0:17889:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787583225.845788:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b73d5 00000020:00000080:2.0:1787583225.845913:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787583225.845921:0:17889:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787583225.845925:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x19a47956376b73dc 00080000:01000000:2.0:1787583225.845941:0:17889:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787583225.845946:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x19a47956376b73e3 00010000:00010000:3.0:1787583225.902490:0:17889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1787583225.903024:0:17889:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1787583225.903299:0:17889:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787583225.905157:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787583225.905169:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583225.905175:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583225.905177:0:17889:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787583225.905181:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583225.905186:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583225.905187:0:17889:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787583225.905190:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787583225.905195:0:17889:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:3.0:1787583225.905220:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787583225.905233:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9092466899b8) 00000020:00000080:3.0:1787583225.905253:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787583225.905257:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787583225.905337:0:17889:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787583225.905344:0:17889:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787583225.905352:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x19a47956376b73f1 00010000:00080000:3.0:1787583225.905383:0:17889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909247c47000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1787583225.910887:0:17889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1787583225.912795:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787583225.912808:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787583225.912842:0:17889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787583225.912896:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b73f8 00000100:00080000:0.0:1787583225.912907:0:17889:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787583225.912913:0:17889:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff909247c47000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1787583225.912955:0:17889:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247ef6d80 x1874416435898240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787583225.912990:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435898240:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787583225.913054:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583225.913123:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435898240 00000100:00100000:0.0:1787583225.913130:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435898240 00000100:00100000:0.0:1787583225.913158:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787583225.913165:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874416435898240:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787583225.913186:0:17159:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1787583225.913220:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b73ff 00000004:00100000:0.0:1787583225.913235:0:17159:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787583225.913240:0:17159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787583225.913299:0:17889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787583225.913341:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787583225.913346:0:15041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787583225.913355:0:15041:0:(import.c:65:import_set_state_nolock()) ffff909342bcd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787583225.913359:0:15041:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:0.0:1787583225.913363:0:15041:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787583225.913368:0:15041:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff909342bcd800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1787583225.913381:0:15041:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247ef6680 x1874416435898496/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787583225.913394:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787583225.913398:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787583225.913400:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787583225.913403:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787583225.913430:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787583225.913438:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435898368:0@lo:400:kworker.0 00000100:00100000:0.0:1787583225.913471:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583225.913495:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435898624:0@lo:400:kworker.0 00000100:00100000:0.0:1787583225.913520:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583225.913549:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435898368 00000100:00100000:0.0:1787583225.913553:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435898368 00000100:00100000:0.0:1787583225.913578:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787583225.913585:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+15:3655:x1874416435898368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583225.913626:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+15:3655:x1874416435898368:12345-0@lo:400:kworker.0 Request processed in 41us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583225.913632:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787583225.913677:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435898624 00000100:00100000:0.0:1787583225.913681:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435898624 00000100:00100000:0.0:1787583225.913703:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787583225.913716:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435898624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583225.913750:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435898624:12345-0@lo:400:kworker.0 Request processed in 34us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583225.913756:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787583225.913790:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff909247ef5f80 x1874416435898624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583225.913802:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435898624:0@lo:400:kworker.0 00000100:00100000:0.0:1787583225.913825:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435898368:0@lo:400:kworker.0 00000100:00100000:0.0:1787583225.913840:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435898496:0@lo:38:kworker.0 00000100:00100000:0.0:1787583225.913883:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787583225.913945:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787583225.913951:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583225.913952:0:17889:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787583225.913956:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787583225.913958:0:17889:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787583225.913960:0:17889:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787583225.913961:0:17889:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787583225.913962:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787583225.913964:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583225.913965:0:17889:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787583225.913968:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787583225.913971:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583225.913973:0:17889:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787583225.913976:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787583225.914013:0:17889:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787583225.914025:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787583225.914029:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583225.914031:0:17889:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787583225.914034:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787583225.914041:0:17889:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1787583225.914042:0:17889:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787583225.914044:0:17889:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787583225.914046:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787583225.914049:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583225.914050:0:17889:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787583225.914052:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787583225.914055:0:17889:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787583225.914058:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583225.914060:0:17889:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787583225.914063:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787583225.914066:0:17889:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1787583225.914084:0:17889:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787583225.914087:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787583225.914100:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90937fbc4d28) 00000020:00000080:0.0:1787583225.914113:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787583225.914118:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787583225.914183:0:17889:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787583225.914190:0:17889:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787583225.914197:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x19a47956376b740d 00010000:00080000:0.0:1787583225.914224:0:17889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909348746000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1787583225.914437:0:17889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1787583225.914895:0:17158:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787583225.914903:0:17158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1787583225.915382:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435898496 00000100:00100000:1.0:1787583225.915390:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435898496 00000100:00100000:0.0:1787583225.917466:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787583225.917480:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3652:x1874416435898496:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787583225.917583:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3652:x1874416435898496:12345-0@lo:38:kworker.0 Request processed in 102us (3698us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787583225.917591:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787583225.917631:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787583225.917639:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909342bcd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787583225.917655:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787583225.917659:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435898496:0@lo:38:kworker.0 00000100:00080000:1.0:1787583225.925568:0:17159:0:(import.c:65:import_set_state_nolock()) ffff90937fc53000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787583225.925685:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1874416435898240:12345-0@lo:38:llog_process_th.0 Request processed in 12515us (12627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583225.925696:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787583225.925816:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787583225.925827:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787583225.925836:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787583225.925842:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787583225.925870:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909247c47000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787583225.925886:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435898240:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787583225.926107:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787583225.926122:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435898752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583225.926164:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583225.926199:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435898752 00000100:00100000:1.0:1787583225.926205:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435898752 00000100:00100000:1.0:1787583225.926242:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787583225.926250:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1874416435898752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787583225.926275:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787583225.926311:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1874416435898752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583225.926318:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787583225.926347:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435898752:0@lo:41:osp-pre-0-1.0 00000040:01000000:3.0:1787583225.927151:0:17889:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787583225.927327:0:17889:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787583225.929166:0:17889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787583225.929401:0:17889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787583225.929556:0:17889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1787583225.929927:0:17895:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787583225.929943:0:17895:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787583225.930622:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787583225.930633:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787583225.930680:0:17889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787583225.930700:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b7414 00000100:00080000:1.0:1787583225.930709:0:17889:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787583225.930715:0:17889:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff909348746000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583225.930749:0:17889:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909348843480 x1874416435898880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787583225.930781:0:17889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787583225.930842:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787583225.930871:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583225.930873:0:17889:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787583225.930877:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787583225.930880:0:17889:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1787583225.930881:0:17889:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787583225.930883:0:17889:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787583225.930884:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787583225.930886:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583225.930888:0:17889:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787583225.930891:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787583225.930894:0:17889:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787583225.930898:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583225.930899:0:17889:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787583225.930902:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787583225.930905:0:17889:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000100:00100000:2.0:1787583225.931075:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435898880:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787583225.931130:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416435898880 offset 0 length 520: 4 00000020:01000000:1.0:1787583225.931197:0:17889:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787583225.931202:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787583225.931212:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff909373fdcd28) 00000020:00000080:1.0:1787583225.931225:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1787583225.931230:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787583225.931298:0:17889:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787583225.931305:0:17889:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787583225.931311:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x19a47956376b7422 00010000:00080000:1.0:1787583225.931336:0:17889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909247c41800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.111@tcp at head 00000100:00080000:3.0:1787583225.931579:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583225.931588:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583225.931591:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583225.931594:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787583225.931669:0:17889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787583225.931732:0:17889:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787583225.931747:0:17889:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787583225.934096:0:17889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787583225.934410:0:17889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787583225.934553:0:17889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787583225.935071:0:17897:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787583225.935077:0:17897:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787583225.936135:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787583225.936148:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787583225.936188:0:17889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787583225.936210:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b7429 00000100:00080000:0.0:1787583225.936220:0:17889:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787583225.936225:0:17889:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff909247c41800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1787583225.936260:0:17889:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247ef6680 x1874416435899008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787583225.936289:0:17889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787583225.936336:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435899008:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1787583225.936344:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787583225.936350:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583225.936351:0:17889:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787583225.936355:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787583225.936359:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583225.936360:0:17889:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787583225.936363:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787583225.936365:0:17889:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787583225.936367:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787583225.936371:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583225.936373:0:17889:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787583225.936375:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787583225.936377:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583225.936379:0:17889:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787583225.936383:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000400:00000100:2.0:1787583225.936393:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416435899008 offset 0 length 520: 4 00000020:01000000:0.0:1787583225.936408:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787583225.936411:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583225.936413:0:17889:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787583225.936417:0:17889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1787583225.936483:0:17885:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787583225.936521:0:17885:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787583225.936540:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c52400/0x19a47956376b73ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b73b2 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583225.936552:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909247c52400/0x19a47956376b73ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b73b2 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583225.936560:0:17885:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90935822f800 from 1 10000000:01000000:2.0:1787583225.936564:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787583225.936590:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583225.936598:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583225.936609:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583225.936624:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787583225.936678:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583225.936701:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909345600840 going to sleep for 11 seconds 00000100:00080000:3.0:1787583225.936762:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583225.936767:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583225.936770:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583225.936773:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787583225.936814:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435899136 00000100:00100000:0.0:1787583225.936831:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435899136 00000100:00100000:0.0:1787583225.936894:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787583225.936903:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+15:17885:x1874416435899136:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583225.936915:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583225.937009:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713e000/0x19a47956376b7437 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b7430 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.937032:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713e000/0x19a47956376b7437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b7430 expref: 16 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.937042:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713e000/0x19a47956376b7437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7430 expref: 16 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.937050:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e000, rc 0) 00000100:00100000:0.0:1787583225.937096:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+16:17885:x1874416435899136:12345-0@lo:101:mount.lustre.0 Request processed in 193us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583225.937102:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787583225.937183:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787583225.937196:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7437 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583225.937211:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7437 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583225.937993:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899264:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787583225.938035:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583225.938109:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909345600840 going to sleep for 11 seconds 00000100:00100000:1.0:1787583225.938149:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435899264 00000100:00100000:1.0:1787583225.938155:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435899264 00000100:00100000:1.0:1787583225.938231:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787583225.938240:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+16:17885:x1874416435899264:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787583225.938255:0:17148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787583225.938272:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787583225.938275:0:17148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787583225.938360:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+16:17885:x1874416435899264:12345-0@lo:256:mount.lustre.0 Request processed in 121us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583225.938367:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787583225.938436:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899264:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787583225.939552:0:17885:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787583225.939583:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7437 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.939595:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7437 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583225.939604:0:17885:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90935822f800 from 1 10000000:01000000:0.0:1787583225.939607:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787583225.939637:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.941387:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.941401:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583225.941430:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787583225.941503:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583225.941557:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736a4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787583225.942765:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435899392 00000100:00100000:3.0:1787583225.942778:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435899392 00000100:00100000:3.0:1787583225.942873:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787583225.942885:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+16:17885:x1874416435899392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787583225.942902:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583225.942920:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909248497200/0x19a47956376b7445 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b743e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583225.942945:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909248497200/0x19a47956376b7445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b743e expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583225.942954:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909248497200/0x19a47956376b7445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b743e expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583225.942963:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248497200, rc 0) 00000100:00100000:3.0:1787583225.943027:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+17:17885:x1874416435899392:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583225.943049:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787583225.943191:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583225.943218:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7445 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.943228:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7445 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787583225.943358:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787583225.943394:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787583225.943427:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583225.943463:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736a4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787583225.943780:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435899520 00000100:00100000:1.0:1787583225.943786:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435899520 00000100:00100000:1.0:1787583225.943820:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787583225.943828:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+17:17885:x1874416435899520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583225.943930:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+17:17885:x1874416435899520:12345-0@lo:501:mount.lustre.0 Request processed in 102us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583225.943937:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787583225.944315:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787583225.944348:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787583225.944391:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583225.944422:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736a4600 going to sleep for 11 seconds 00000100:00100000:2.0:1787583225.944453:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435899648 00000100:00100000:2.0:1787583225.944459:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435899648 00000100:00100000:2.0:1787583225.944494:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787583225.944512:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+17:17885:x1874416435899648:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787583225.944603:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+17:17885:x1874416435899648:12345-0@lo:503:mount.lustre.0 Request processed in 101us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583225.944610:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787583225.944714:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899648:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787583225.945114:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787583225.945186:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787583225.946939:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583225.946980:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736a4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787583225.947715:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435899776 00000100:00100000:2.0:1787583225.947724:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435899776 00000100:00100000:2.0:1787583225.947784:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787583225.947802:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+17:17885:x1874416435899776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787583225.947978:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+17:17885:x1874416435899776:12345-0@lo:502:mount.lustre.0 Request processed in 185us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583225.947987:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787583225.948667:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787583225.948908:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787583225.948936:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1787583225.948948:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1787583225.948959:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1787583225.948969:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1787583225.948979:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1787583225.948989:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1787583225.949017:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1787583225.949029:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787583225.949040:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1787583225.949050:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1787583225.949080:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787583225.949132:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583225.949173:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344d43e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787583225.950138:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435899904 00000100:00100000:3.0:1787583225.950147:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435899904 00000100:00100000:3.0:1787583225.950214:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787583225.950225:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+17:17885:x1874416435899904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583225.950353:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+17:17885:x1874416435899904:12345-0@lo:502:mount.lustre.0 Request processed in 130us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583225.950362:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787583225.950603:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435899904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787583225.951805:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1787583225.951824:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787583225.953956:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787583225.953969:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583225.953972:0:17899:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787583225.953981:0:17899:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90935822f800 00000020:00000080:2.0:1787583225.953985:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787583225.953992:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787583225.954007:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583225.954008:0:17899:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787583225.954012:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787583225.954014:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583225.954015:0:17899:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787583225.954018:0:17899:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90935822f800 00000020:00000080:2.0:1787583225.954020:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787583225.954080:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787583225.954083:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583225.954084:0:17899:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787583225.954087:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787583225.954089:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583225.954091:0:17899:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787583225.954094:0:17899:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90935822f800 00000020:00000080:2.0:1787583225.954095:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787583225.954111:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787583225.954114:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583225.954115:0:17899:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787583225.954117:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787583225.954119:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583225.954121:0:17899:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787583225.954124:0:17899:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90935822f800 00000020:00000080:2.0:1787583225.954126:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787583225.954147:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787583225.954149:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583225.954151:0:17899:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787583225.954153:0:17899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1787583225.954308:0:17885:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787583225.954343:0:17885:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787583225.954366:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7445 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.954379:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7445 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583225.954429:0:17885:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787583225.954431:0:17885:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90935822f800 10000000:01000000:0.0:1787583225.954434:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90935822f800 10000000:01000000:0.0:1787583225.954437:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787583225.954442:0:17885:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90935822f800 from 1 10000000:01000000:0.0:1787583225.954444:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787583225.954477:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713f600/0x19a47956376b744c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.954484:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924713f600/0x19a47956376b744c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.954494:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924713f600/0x19a47956376b744c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583225.954519:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787583225.954578:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583225.954635:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093736a4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787583225.954711:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435900032 00000100:00100000:3.0:1787583225.954719:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435900032 00000100:00100000:3.0:1787583225.954773:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787583225.954783:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+17:17885:x1874416435900032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787583225.954797:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583225.954809:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909248496a00/0x19a47956376b7453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b744c expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583225.954830:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909248496a00/0x19a47956376b7453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b744c expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583225.954839:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909248496a00/0x19a47956376b7453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b744c expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583225.954869:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248496a00, rc 0) 00000100:00100000:3.0:1787583225.954906:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900032:12345-0@lo:101:mount.lustre.0 Request processed in 125us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583225.954912:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787583225.955001:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583225.955014:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924713f600/0x19a47956376b744c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7453 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583225.955023:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924713f600/0x19a47956376b744c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7453 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787583225.956946:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787583225.957242:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787583225.957397:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787583225.957417:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1787583225.957427:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1787583225.957438:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1787583225.957447:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1787583225.957460:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1787583225.957471:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1787583225.957481:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1787583225.957490:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1787583225.957702:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1787583225.957719:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1787583225.957821:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1787583225.957837:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1787583225.957934:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1787583225.957947:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1787583225.957957:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1787583225.957985:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1787583225.957998:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1787583225.958010:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1787583225.958022:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1787583225.958034:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1787583225.958045:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1787583225.958056:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1787583225.958068:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1787583225.958177:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1787583225.958196:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1787583225.958721:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1787583225.958753:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1787583225.958777:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1787583225.958783:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787583225.958902:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583225.958967:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583225.959014:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344d43e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787583225.959045:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435900160 00000100:00100000:2.0:1787583225.959053:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435900160 00000100:00100000:2.0:1787583225.959111:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787583225.959121:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787583225.959251:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900160:12345-0@lo:501:mount.lustre.0 Request processed in 131us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583225.959266:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787583225.959358:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583225.959389:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787583225.959426:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583225.959460:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435900288 00000100:00100000:1.0:1787583225.959460:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344d43e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787583225.959470:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435900288 00000100:00100000:3.0:1787583225.959503:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787583225.959511:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900288:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787583225.959597:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900288:12345-0@lo:503:mount.lustre.0 Request processed in 86us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583225.959604:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787583225.959622:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900288:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787583225.960813:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787583225.961697:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787583225.961766:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583225.961803:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093456009c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583225.962431:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435900416 00000100:00100000:3.0:1787583225.962440:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435900416 00000100:00100000:3.0:1787583225.962488:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787583225.962498:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583225.962634:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900416:12345-0@lo:502:mount.lustre.0 Request processed in 138us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583225.962652:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787583225.963044:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787583225.963318:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787583225.963349:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1787583225.963367:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1787583225.963381:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1787583225.963397:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1787583225.963412:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1787583225.963428:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1787583225.963460:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1787583225.963481:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1787583225.963497:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1787583225.968209:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1787583225.968230:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1787583225.968242:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1787583225.968254:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1787583225.968267:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1787583225.968279:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1787583225.968291:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1787583225.968303:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1787583225.968317:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1787583225.968328:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1787583225.968339:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1787583225.968362:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1787583225.968387:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1787583225.968401:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1787583225.968413:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1787583225.968424:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1787583225.968436:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1787583225.968459:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1787583225.968473:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1787583225.968485:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1787583225.968498:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1787583225.968572:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1787583225.968586:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1787583225.968599:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1787583225.968612:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1787583225.968625:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1787583225.973743:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1787583225.973793:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1787583225.973829:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1787583225.973857:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1787583225.973873:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1787583225.973887:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1787583225.973899:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1787583225.973912:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1787583225.973925:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1787583225.973937:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1787583225.973951:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1787583225.973962:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1787583225.974017:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787583225.974099:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583225.974148:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093456000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583225.974581:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435900544 00000100:00100000:3.0:1787583225.974591:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435900544 00000100:00100000:3.0:1787583225.975251:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787583225.975263:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583225.975398:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900544:12345-0@lo:502:mount.lustre.0 Request processed in 137us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583225.975406:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787583225.975924:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787583225.976206:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1787583225.976246:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1787583225.976282:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787583225.976329:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583225.984548:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435900672 00000100:00100000:2.0:1787583225.984562:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435900672 00000100:00100000:2.0:1787583225.984620:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787583225.984630:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787583225.984653:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f00f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787583225.984804:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900672:12345-0@lo:502:mount.lustre.0 Request processed in 175us (8474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583225.984812:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787583225.986164:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787583225.986253:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1787583225.986267:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787583225.989972:0:17904:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787583225.989989:0:17904:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff90936db24d28) 00000020:00000080:2.0:1787583225.990010:0:17904:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787583225.990078:0:17904:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90935822f800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787583225.990083:0:17904:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90935822f800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787583225.990098:0:17904:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90935822f800 3 00010000:00080000:2.0:1787583225.990126:0:17904:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909247e4d800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1787583225.991706:0:17904:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1787583225.991942:0:17904:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787583225.991981:0:17904:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787583225.991994:0:17904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x19a47956376b7461 00000100:00080000:2.0:1787583225.992004:0:17904:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787583225.992009:0:17904:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff909247e4d800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583225.992044:0:17904:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f81880 x1874416435900800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787583225.992084:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874416435900800:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787583225.992148:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787583225.992206:0:17904:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787583225.992605:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583225.992610:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583225.992613:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583225.992616:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787583225.994559:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435900800 00000100:00100000:1.0:1787583225.994572:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435900800 00000100:00100000:1.0:1787583225.994622:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787583225.994630:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874416435900800:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787583225.994671:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1787583225.994719:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x19a47956376b7468 00000004:00100000:1.0:1787583225.994750:0:17155:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787583225.994782:0:17155:0:(import.c:65:import_set_state_nolock()) ffff90936d8a7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787583225.994899:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874416435900800:12345-0@lo:38:llog_process_th.0 Request processed in 268us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583225.994907:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787583225.995067:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff909247f81880 x1874416435900800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787583235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583225.995078:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787583225.995091:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787583225.995099:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787583225.995104:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787583225.995107:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909247e4d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787583225.995115:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874416435900800:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787583225.995788:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1787583225.996075:0:17885:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787583225.996106:0:17885:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787583225.996126:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713f600/0x19a47956376b744c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7453 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583225.996136:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924713f600/0x19a47956376b744c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7453 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787583225.996208:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787583225.996210:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787583225.996211:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787583225.996213:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787583225.996214:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787583225.996216:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787583225.996217:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787583225.996219:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787583225.996220:0:17885:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787583225.996223:0:17885:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1787583225.996225:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787583225.996227:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787583225.996228:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787583225.996229:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787583225.996229:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787583225.996231:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787583225.996232:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787583225.996233:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787583225.996234:0:17885:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787583225.996256:0:17885:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787583225.996278:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900928:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787583225.996325:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583225.996357:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff90934562b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583225.997083:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435900928 00000100:00100000:2.0:1787583225.999204:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435900928 00000100:00100000:2.0:1787583225.999422:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787583225.999431:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900928:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787583225.999470:0:17148:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787583225.999482:0:17148:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1787583226.002043:0:17133:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787583226.002126:0:17148:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787583226.002144:0:17148:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1787583226.002324:0:17169:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787583226.002329:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787583226.002351:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.002368:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909247c52e00/0x19a47956376b7373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b736c expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.002376:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924713e000/0x19a47956376b7437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7430 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.002383:0:17169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.002421:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924713e000/0x19a47956376b7437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b7430 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.002435:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90924713e000/0x19a47956376b7437 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b7430 expref: 18 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583226.002458:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435901056:0@lo:104: 00000100:00100000:1.0:1787583226.002521:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583226.002586:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:17885:1874416435900928:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787583226.002597:0:17885:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787583226.002600:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787583226.002602:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787583226.002603:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787583226.002604:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787583226.002606:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787583226.002607:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787583226.002608:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787583226.002610:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787583226.002611:0:17885:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787583226.002624:0:17885:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787583226.006310:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435901056 00000100:00100000:0.0:1787583226.006325:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435901056 00000100:00100000:0.0:1787583226.006379:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787583226.006389:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea761437-c095-48a5-91f7-0c431111ca6a+3:17169:x1874416435901056:12345-0@lo:104: 00010000:00010000:0.0:1787583226.006406:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b7437 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.007423:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909247c52e00/0x19a47956376b7373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b736c expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.007440:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff909247c52e00/0x19a47956376b7373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b736c expref: 18 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583226.007472:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435901184:0@lo:104: 00000100:00100000:1.0:1787583226.007529:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583226.007549:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff90934562bf00 going to sleep for 11 seconds 00010000:00010000:0.0:1787583226.009511:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787583226.009523:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea761437-c095-48a5-91f7-0c431111ca6a+3:17169:x1874416435901056:12345-0@lo:104: Request processed in 3133us (6998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583226.009546:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787583226.009572:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435901184 00000100:00100000:0.0:1787583226.009578:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435901184 00000100:00100000:0.0:1787583226.009606:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787583226.009614:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea761437-c095-48a5-91f7-0c431111ca6a+3:17169:x1874416435901184:12345-0@lo:104: 00010000:00010000:0.0:1787583226.009629:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b7373 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583226.009691:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787583226.009698:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea761437-c095-48a5-91f7-0c431111ca6a+3:17169:x1874416435901184:12345-0@lo:104: Request processed in 84us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583226.009705:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787583226.009736:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787583226.009742:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b7437 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583226.009751:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583226.009755:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b7437 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583226.009765:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b7437 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583226.009773:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b7437 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583226.009778:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787583226.009816:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7437 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583226.009835:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787583226.009880:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7437 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583226.009888:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344dec200/0x19a47956376b7430 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7437 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583226.009899:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583226.009903:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b7373 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583226.009909:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713ea00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583226.009912:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b7373 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583226.009918:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b7373 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583226.009925:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b7373 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583226.010039:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787583226.010056:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7373 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583226.010062:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787583226.010068:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7373 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583226.010075:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924713ea00/0x19a47956376b736c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7373 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583226.010176:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583226.010178:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583226.010180:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583226.010203:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435901312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583226.010319:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787583226.010403:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583226.010462:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787583226.010468:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435901440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583226.010493:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583226.010562:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:17885:x1874416435900928:12345-0@lo:253:mount.lustre.0 Request processed in 11130us (14234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583226.010573:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787583226.012896:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435901056:0@lo:104: 00000100:00100000:2.0:1787583226.012911:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435901184:0@lo:104: 00010000:00010000:2.0:1787583226.012933:0:17169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583226.015369:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435901312 00000100:00100000:1.0:1787583226.015381:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435901312 00010000:00010000:1.0:1787583226.015463:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924713e000/0x19a47956376b7437 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b7430 expref: 18 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583226.015502:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435901440 00000100:00100000:1.0:1787583226.015506:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435901440 00010000:00010000:1.0:1787583226.015519:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909247c52e00/0x19a47956376b7373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b736c expref: 19 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583226.015534:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787583226.015542:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea761437-c095-48a5-91f7-0c431111ca6a+19:3655:x1874416435901312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583226.015555:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583226.015560:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924713e000/0x19a47956376b7437 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b7430 expref: 19 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015572:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924713e000/0x19a47956376b7437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b7430 expref: 19 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015589:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713e000/0x19a47956376b7437 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b7430 expref: 19 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015603:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583226.015677:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea761437-c095-48a5-91f7-0c431111ca6a+18:3655:x1874416435901312:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (5357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583226.015684:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787583226.015711:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787583226.015718:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea761437-c095-48a5-91f7-0c431111ca6a+17:3655:x1874416435901440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583226.015726:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583226.015731:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909247c52e00/0x19a47956376b7373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b736c expref: 17 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015741:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909247c52e00/0x19a47956376b7373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b736c expref: 17 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015751:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909247c52e00/0x19a47956376b7373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b736c expref: 17 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015761:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015770:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787583226.015784:0:17138:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013455151s 00010000:00010000:1.0:1787583226.015788:0:17138:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015795:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015801:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015807:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015812:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53e00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787583226.015822:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015830:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015870:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015881:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583226.015907:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea761437-c095-48a5-91f7-0c431111ca6a+16:3655:x1874416435901440:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (5413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583226.015914:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787583226.015940:0:17169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015948:0:17169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583226.015954:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909247c53e00/0x19a47956376b746f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1787583226.017686:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000100:00100000:0.0:1787583226.021915:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435901440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583226.021930:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435901312:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787583226.022047:0:17909:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787583226.022052:0:17909:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787583226.023407:0:17910:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1787583226.023742:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787583226.024037:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1787583226.029741:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787583226.029811:0:17910:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1787583226.033822:0:17911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1874416435901568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787583226.033941:0:17911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583226.033972:0:17911:0:(client.c:2715:ptlrpc_set_wait()) set ffff909350a789c0 going to sleep for 11 seconds 00000040:01000000:0.0:1787583226.034490:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787583226.034529:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787583226.034996:0:17885:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787583226.035003:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787583226.035042:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787583226.036193:0:17885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787583226.036748:0:17885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787583226.036777:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787583226.036900:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787583226.037412:0:17885:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:2.0:1787583226.038133:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435901568 00000100:00100000:2.0:1787583226.038145:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435901568 00000100:00100000:2.0:1787583226.038200:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787583226.038222:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17911:x1874416435901568:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787583226.038338:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17911:x1874416435901568:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 118us (4405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583226.038346:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787583226.038392:0:17911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1874416435901568:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787583226.038427:0:17911:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787583226.038467:0:17911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1874416435901696:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787583226.038503:0:17911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583226.038532:0:17911:0:(client.c:2715:ptlrpc_set_wait()) set ffff909350a789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583226.038781:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435901696 00000100:00100000:3.0:1787583226.038786:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435901696 00000100:00100000:3.0:1787583226.038813:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787583226.038819:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17911:x1874416435901696:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787583226.038949:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17911:x1874416435901696:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 130us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583226.038956:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:00000004:1.0:1787583226.042473:0:17885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787583226.045184:0:17911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1874416435901696:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787583226.045358:0:17911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17911:1874416435901824:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787583226.045417:0:17911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583226.045453:0:17911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9093453f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787583226.045540:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435901824 00000100:00100000:2.0:1787583226.045547:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435901824 00000100:00100000:2.0:1787583226.045593:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787583226.045602:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17911:x1874416435901824:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787583226.045663:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17911:x1874416435901824:12345-0@lo:900:lod0001_rec0000.0 Request processed in 62us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583226.045671:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787583226.045807:0:17911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90937fc8a680 x1874416435901824/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787583242 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583226.045820:0:17911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17911:1874416435901824:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787583226.045906:0:17911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1874416435901952:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787583226.046053:0:17911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583226.047135:0:17911:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365f5b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787583226.049053:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435901952 00000100:00100000:2.0:1787583226.049066:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435901952 00000100:00100000:2.0:1787583226.049317:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787583226.049331:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17911:x1874416435901952:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787583226.049474:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17911:x1874416435901952:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 145us (3420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583226.049482:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787583226.049669:0:17911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1874416435901952:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787583226.049737:0:17911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787583226.052591:0:17911:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787583226.052673:0:17911:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787583226.052678:0:17911:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1787583226.060602:0:17885:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787583226.060651:0:17885:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa3cd4554f988 00100000:10000000:1.0:1787583226.060660:0:17885:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787583226.061665:0:17885:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787583226.061703:0:17885:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787583226.061721:0:17885:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787583226.061746:0:17885:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787583226.087768:0:17885:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787583226.088045:0:17885:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787583226.126030:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00010000:00010000:2.0:1787583226.708249:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787583227.086662:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787583227.149945:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 10000000:01000000:0.0:1787583227.663190:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787583227.663198:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90935822f800 from 8 10000000:01000000:0.0:1787583227.663203:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787583227.663247:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583227.663258:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583227.663268:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583227.663292:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435902080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787583227.663359:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583227.663415:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344a80540 going to sleep for 11 seconds 00000100:00100000:3.0:1787583227.665039:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435902080 00000100:00100000:3.0:1787583227.665065:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435902080 00000100:00100000:3.0:1787583227.665140:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787583227.665150:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+16:17151:x1874416435902080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787583227.665166:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583227.665182:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909248497400/0x19a47956376b747d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b7476 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583227.665209:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909248497400/0x19a47956376b747d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b7476 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583227.665219:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909248497400/0x19a47956376b747d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7476 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583227.665228:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248497400, rc 0) 00000100:00100000:3.0:1787583227.665299:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+17:17151:x1874416435902080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583227.665306:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787583227.665950:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435902080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583227.665974:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b747d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583227.665984:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b747d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583227.666043:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435902208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787583227.666194:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583227.666230:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247690a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787583227.666462:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435902208 00000100:00100000:1.0:1787583227.666474:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435902208 00000100:00100000:1.0:1787583227.666513:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787583227.666521:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+17:17151:x1874416435902208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787583227.666536:0:17148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787583227.666557:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787583227.666560:0:17148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787583227.666664:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+17:17151:x1874416435902208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583227.666672:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787583227.667626:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435902208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787583227.667689:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787583227.667698:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b747d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583227.667708:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b747d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583227.667718:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787583227.667721:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff909248438000 from 8 10000000:01000000:0.0:1787583227.667723:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787583227.667748:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583227.667762:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583227.667770:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583227.667786:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435902336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787583227.667822:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583227.668944:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435902336 00000100:00100000:2.0:1787583227.668953:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435902336 00000100:00100000:0.0:1787583227.669766:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344a80540 going to sleep for 11 seconds 00000100:00100000:2.0:1787583227.669768:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787583227.670681:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+17:17151:x1874416435902336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583227.670699:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583227.670716:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344ded000/0x19a47956376b748b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b7484 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583227.670744:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344ded000/0x19a47956376b748b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b7484 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583227.670755:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344ded000/0x19a47956376b748b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7484 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583227.670765:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344ded000, rc 0) 00000100:00100000:2.0:1787583227.671237:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+18:17151:x1874416435902336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 566us (3412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583227.671245:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787583227.671303:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435902336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787583227.671319:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b748b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583227.671326:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b748b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583227.671377:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435902464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787583227.671408:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583227.671461:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344a80540 going to sleep for 11 seconds 00000100:00100000:1.0:1787583227.671592:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435902464 00000100:00100000:1.0:1787583227.671600:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435902464 00000100:00100000:1.0:1787583227.671658:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787583227.671666:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:17151:x1874416435902464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787583227.671681:0:17148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787583227.671695:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787583227.671698:0:17148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787583227.672206:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:17151:x1874416435902464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 539us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583227.672214:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787583227.672271:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435902464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787583227.672323:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787583227.672330:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b748b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583227.672339:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b748b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583227.725997:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787583228.111104:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787583228.180990:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00010000:00010000:2.0:1787583228.750556:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583229.202305:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00010000:00010000:1.0:1787583229.774275:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787583230.179307:0:18155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787583230.222023:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00010000:00010000:0.0:1787583230.801030:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787583230.942775:0:18207:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787583230.943022:0:18207:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787583231.247067:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 0 seconds 00000100:00080000:3.0:1787583231.438349:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787583231.438357:0:15041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787583231.438361:0:15041:0:(import.c:65:import_set_state_nolock()) ffff909342bcd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787583231.438373:0:15041:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff909342bcd800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787583231.438395:0:15041:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc88000 x1874416435902720/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787583231.438414:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583231.438417:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583231.438419:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583231.438422:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583231.438454:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583231.438457:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583231.438460:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583231.438462:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787583231.438493:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435902720:0@lo:38:kworker.0 00000100:00100000:3.0:1787583231.438556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583231.438640:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435902720 00000100:00100000:3.0:1787583231.438647:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435902720 00000100:00100000:3.0:1787583231.438681:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787583231.438689:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874416435902720:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787583231.438714:0:17159:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:3.0:1787583231.438749:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b7492 00000004:00100000:3.0:1787583231.438765:0:17159:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787583231.438771:0:17159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787583231.439952:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435902592:0@lo:400:kworker.0 00000100:00100000:0.0:1787583231.440011:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583231.440056:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583231.440075:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435902848:0@lo:400:kworker.0 00000100:00100000:0.0:1787583231.440116:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583231.440147:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435902976:0@lo:400:kworker.0 00000100:00100000:0.0:1787583231.440172:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583231.440195:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787583231.440201:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435903104:0@lo:400:kworker.0 00000100:00100000:0.0:1787583231.440230:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583231.440263:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435902592 00000100:00100000:0.0:1787583231.440269:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435902592 00000100:00100000:0.0:1787583231.440308:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787583231.440316:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909344f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+18:3653:x1874416435902592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583231.440371:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909344f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+18:3653:x1874416435902592:12345-0@lo:400:kworker.0 Request processed in 50us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583231.440380:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787583231.440415:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435902848 00000100:00100000:0.0:1787583231.440419:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435902848 00000100:00100000:0.0:1787583231.440446:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435903104 00000100:00100000:0.0:1787583231.440449:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435903104 00000100:00100000:0.0:1787583231.440463:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787583231.440469:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435902848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583231.440501:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435902848:12345-0@lo:400:kworker.0 Request processed in 32us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583231.440509:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787583231.440520:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787583231.440526:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435903104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583231.440565:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435903104:12345-0@lo:400:kworker.0 Request processed in 39us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583231.440581:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787583231.440620:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435902976 00000100:00100000:0.0:1787583231.440625:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435902976 00000100:00100000:0.0:1787583231.440649:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787583231.440656:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435902976:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787583231.441119:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90937fc88380 x1874416435903104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583231.441134:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435902976:12345-0@lo:400:kworker.0 Request processed in 476us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583231.441142:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787583231.441152:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435903104:0@lo:400:kworker.0 00000100:00100000:2.0:1787583231.441173:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435902976:0@lo:400:kworker.0 00010000:00080000:0.0:1787583231.441193:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90937fc8a680 x1874416435902848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583231.441204:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435902848:0@lo:400:kworker.0 00000100:00100000:0.0:1787583231.441214:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435902592:0@lo:400:kworker.0 00000100:00100000:3.0:1787583231.449787:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787583231.449809:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435903232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583231.449892:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583231.449935:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435903232 00000100:00100000:3.0:1787583231.449943:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435903232 00000100:00100000:3.0:1787583231.449986:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787583231.449996:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435903232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787583231.450027:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787583231.450086:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435903232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583231.450093:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787583231.450209:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435903232:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787583231.462723:0:17159:0:(import.c:65:import_set_state_nolock()) ffff909247c5f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787583231.462833:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874416435902720:12345-0@lo:38:kworker.0 Request processed in 24142us (24276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583231.462867:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787583231.463242:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787583231.463252:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787583231.463258:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787583231.463261:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909342bcd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787583231.463284:0:3652:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008d4f7406): req@ffff909348843b80 x1874416435895680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583231.463310:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435902720:0@lo:38:kworker.0 00000100:00100000:1.0:1787583231.463413:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787583231.463428:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435903360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583231.463482:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583231.463528:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435903360 00000100:00100000:1.0:1787583231.463534:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435903360 00000100:00100000:1.0:1787583231.463573:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787583231.463582:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435903360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787583231.463619:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787583231.463662:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435903360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583231.463669:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787583231.463685:0:17195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583231.463700:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787583231.463701:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435903360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583231.463711:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435895680 00000100:00100000:2.0:1787583231.463714:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435895680 00000100:00100000:2.0:1787583231.463752:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787583231.463759:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17195:x1874416435895680:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787583231.463824:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17195:x1874416435895680:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 65us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583231.463830:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787583231.463989:0:17195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348843b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1874416435895680:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787583231.464019:0:17195:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787583231.464053:0:17195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348843b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1874416435903488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787583231.464094:0:17195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583231.464113:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365c8e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787583231.464123:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435903488 00000100:00100000:1.0:1787583231.464126:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435903488 00000100:00100000:1.0:1787583231.464145:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787583231.464151:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17195:x1874416435903488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787583231.464253:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17195:x1874416435903488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 101us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583231.464260:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787583231.464385:0:17195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348843b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1874416435903488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787583231.464452:0:17195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1874416435903616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787583231.464477:0:17195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583231.464501:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247690000 going to sleep for 11 seconds 00000100:00100000:1.0:1787583231.465230:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435903616 00000100:00100000:1.0:1787583231.465236:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435903616 00000100:00100000:1.0:1787583231.465273:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787583231.465280:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17195:x1874416435903616:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787583231.465345:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17195:x1874416435903616:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 64us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583231.465351:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787583231.466054:0:17195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1874416435903616:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787583231.466117:0:17195:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787583231.468220:0:17195:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787583231.468299:0:17195:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1787583231.468305:0:17195:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787583231.836739:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787583231.919443:0:18257:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787583231.919683:0:18257:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787583232.848679:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787583233.113290:0:18305:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf9b33b00 20000000:00000080:3.0:1787583233.113380:0:18305:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9093660c5000 uarg=0000000000000000 20000000:01000000:3.0:1787583233.113417:0:18305:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787583233.113423:0:18305:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787583233.113428:0:18305:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787583233.116195:0:18306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1787583233.116389:0:18305:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787583233.129216:0:18305:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787583233.129244:0:18305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583233.129263:0:18305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924713f800/0x19a47956376b7342 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b733b expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583233.129271:0:18305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909248497200/0x19a47956376b7445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b743e expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583233.129278:0:18305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583233.129448:0:18305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909248497200/0x19a47956376b7445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b743e expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583233.129465:0:18305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff909248497200/0x19a47956376b7445 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b743e expref: 17 pid: 17147 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583233.129480:0:18305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18305:1874416435903744:0@lo:104: 00000100:00100000:3.0:1787583233.129545:0:18305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787583233.129614:0:18305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924713f800/0x19a47956376b7342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b733b expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583233.129639:0:18305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90924713f800/0x19a47956376b7342 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b733b expref: 17 pid: 17147 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583233.129647:0:18305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18305:1874416435903872:0@lo:104: 00000100:00100000:3.0:1787583233.129670:0:18305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583233.129689:0:18305:0:(client.c:2715:ptlrpc_set_wait()) set ffff909350a78540 going to sleep for 11 seconds 00000100:00100000:0.0:1787583233.129750:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435903744 00000100:00100000:0.0:1787583233.129760:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435903744 00000100:00100000:1.0:1787583233.129768:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435903872 00000100:00100000:1.0:1787583233.129775:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435903872 00000100:00100000:0.0:1787583233.129806:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787583233.129815:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+4:18305:x1874416435903744:12345-0@lo:104: 00010000:00010000:0.0:1787583233.129832:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b7445 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583233.129908:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787583233.129914:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+4:18305:x1874416435903744:12345-0@lo:104: Request processed in 101us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583233.130043:0:18305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18305:1874416435903744:0@lo:104: 00010000:00010000:1.0:1787583233.132297:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787583233.132311:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b7445 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.132322:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fa00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1787583233.132326:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b7445 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.132336:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b7445 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787583233.132343:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b7445 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583233.132348:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787583233.133817:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7445 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.133829:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787583233.133879:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7445 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.133887:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924713fa00/0x19a47956376b743e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7445 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.133926:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583233.133929:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435904000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583233.133929:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583233.133933:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583233.133998:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583233.134069:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435904000 00000100:00100000:3.0:1787583233.134078:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435904000 00010000:00010000:3.0:1787583233.134110:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909248497200/0x19a47956376b7445 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b743e expref: 18 pid: 17147 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583233.134147:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787583233.134157:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea761437-c095-48a5-91f7-0c431111ca6a+18:3655:x1874416435904000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787583233.134170:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583233.134176:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909248497200/0x19a47956376b7445 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b743e expref: 18 pid: 17147 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583233.134188:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909248497200/0x19a47956376b7445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b743e expref: 18 pid: 17147 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583233.134204:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909248497200/0x19a47956376b7445 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b743e expref: 18 pid: 17147 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583233.134219:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583233.134259:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea761437-c095-48a5-91f7-0c431111ca6a+17:3655:x1874416435904000:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583233.134266:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787583233.134649:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435904000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583233.135947:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787583233.136972:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787583233.136989:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+3:18305:x1874416435903872:12345-0@lo:104: 00010000:00010000:2.0:1787583233.137007:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b7342 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583233.137275:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787583233.137283:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+3:18305:x1874416435903872:12345-0@lo:104: Request processed in 301us (7612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583233.137290:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787583233.137420:0:18305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18305:1874416435903872:0@lo:104: 00010000:00010000:3.0:1787583233.137450:0:18305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583233.140080:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583233.140093:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b7342 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583233.140104:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248497000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583233.140108:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b7342 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583233.140117:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b7342 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583233.140234:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b7342 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583233.140239:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787583233.140433:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7342 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.140441:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787583233.140477:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7342 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.140483:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909248497000/0x19a47956376b733b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7342 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.140500:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583233.140502:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583233.140504:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583233.140609:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435904128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583233.140677:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583233.140928:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435904128 00000100:00100000:1.0:1787583233.140936:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435904128 00010000:00010000:1.0:1787583233.140966:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924713f800/0x19a47956376b7342 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b733b expref: 17 pid: 17147 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583233.141045:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787583233.141054:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea761437-c095-48a5-91f7-0c431111ca6a+17:3656:x1874416435904128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583233.141068:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583233.141074:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924713f800/0x19a47956376b7342 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b733b expref: 17 pid: 17147 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.141085:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924713f800/0x19a47956376b7342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b733b expref: 17 pid: 17147 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.141116:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713f800/0x19a47956376b7342 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b733b expref: 17 pid: 17147 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.141144:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.141151:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.141167:0:17138:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.141174:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.141180:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.141187:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.141193:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248496000 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787583233.141197:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.141204:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.141222:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.141240:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583233.141285:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea761437-c095-48a5-91f7-0c431111ca6a+16:3656:x1874416435904128:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583233.141292:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787583233.141347:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435904128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787583233.141386:0:18305:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583233.141394:0:18305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583233.141401:0:18305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909248496000/0x19a47956376b7499 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583233.873276:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787583234.318459:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787583234.898047:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787583235.024115:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787583235.024123:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90935822f800 from 13 10000000:01000000:1.0:1787583235.024129:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787583235.024183:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583235.024195:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583235.024206:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583235.024230:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435904256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787583235.024300:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583235.024359:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787583235.026329:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435904256 00000100:00100000:3.0:1787583235.026344:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435904256 00000100:00100000:3.0:1787583235.026401:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787583235.026411:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909344f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+16:17151:x1874416435904256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787583235.026427:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583235.026446:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909248496000/0x19a47956376b74a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b74a0 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583235.026472:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909248496000/0x19a47956376b74a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b74a0 expref: 17 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583235.026483:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909248496000/0x19a47956376b74a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b74a0 expref: 17 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583235.026493:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248496000, rc 0) 00000100:00100000:3.0:1787583235.026567:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909344f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+17:17151:x1874416435904256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (2267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583235.026603:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787583235.027036:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435904256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583235.027055:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b74a7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583235.027064:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b74a7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583235.027259:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435904384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583235.027302:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583235.027475:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435904384 00000100:00100000:0.0:1787583235.027481:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435904384 00000100:00100000:0.0:1787583235.027526:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787583235.027535:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909344f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+17:17151:x1874416435904384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787583235.027667:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909344f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+17:17151:x1874416435904384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583235.027673:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787583235.029219:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787583235.029262:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435904384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583235.029349:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435904512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787583235.029425:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583235.029449:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7240 going to sleep for 11 seconds 00000100:00100000:0.0:1787583235.029543:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435904512 00000100:00100000:0.0:1787583235.029550:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435904512 00000100:00100000:0.0:1787583235.029618:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787583235.029629:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909344f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+17:17151:x1874416435904512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787583235.029745:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909344f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+17:17151:x1874416435904512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583235.029752:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787583235.030266:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435904512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787583235.031552:0:18394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787583235.031790:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787583235.031821:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787583235.031832:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b74a7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583235.031874:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b74a7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583235.031893:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787583235.031897:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff909248438000 from 13 10000000:01000000:3.0:1787583235.031900:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787583235.031935:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583235.031944:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583235.031954:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583235.031979:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435904640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787583235.032041:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583235.032087:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247cfc300 going to sleep for 11 seconds 00000100:00100000:0.0:1787583235.032258:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435904640 00000100:00100000:0.0:1787583235.032266:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435904640 00000100:00100000:0.0:1787583235.032314:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787583235.032325:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365c73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+17:17151:x1874416435904640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787583235.032338:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583235.032351:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713ea00/0x19a47956376b74b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b74ae expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583235.032376:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713ea00/0x19a47956376b74b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b74ae expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583235.032385:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713ea00/0x19a47956376b74b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b74ae expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583235.032393:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713ea00, rc 0) 00000100:00100000:0.0:1787583235.032441:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365c73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+18:17151:x1874416435904640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583235.032460:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787583235.035912:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435904640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583235.035942:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b74b5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583235.035956:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b74b5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583235.036035:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435904768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583235.036098:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583235.036134:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583235.036349:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435904768 00000100:00100000:3.0:1787583235.036357:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435904768 00000100:00100000:3.0:1787583235.036418:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787583235.036429:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:17151:x1874416435904768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583235.036544:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:17151:x1874416435904768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583235.036561:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787583235.037314:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435904768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583235.037362:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435904896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787583235.037427:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583235.037472:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583235.037558:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435904896 00000100:00100000:3.0:1787583235.037563:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435904896 00000100:00100000:3.0:1787583235.037615:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787583235.037625:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:17151:x1874416435904896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583235.037721:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:17151:x1874416435904896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583235.037728:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787583235.037834:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435904896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787583235.039305:0:18396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787583235.039587:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787583235.039610:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787583235.039623:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b74b5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583235.039635:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b74b5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583235.534543:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583225/real 1787583225] req@ffff909247ef6680 x1874416435899008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583235 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583235.534584:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff909247ef6680 x1874416435899008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583235 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583235.534596:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583225/real 1787583225] req@ffff909348843480 x1874416435898880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583235 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583235.534609:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff909348843480 x1874416435898880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583235 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787583235.534626:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909247c41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787583235.534647:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787583235.534651:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435899008:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787583235.534658:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909348746000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787583235.534662:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787583235.534665:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435898880:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787583235.535471:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583235.535476:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583235.535479:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583235.535482:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583235.535508:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583235.535511:0:15041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787583235.535515:0:15041:0:(import.c:65:import_set_state_nolock()) ffff909348746000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787583235.535521:0:15041:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:3.0:1787583235.535526:0:15041:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787583235.535546:0:15041:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff909348746000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787583235.535566:0:15041:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc88700 x1874416435905408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787583235.535593:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583235.535596:0:15041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787583235.535598:0:15041:0:(import.c:65:import_set_state_nolock()) ffff909247c41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787583235.535602:0:15041:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:3.0:1787583235.535604:0:15041:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787583235.535608:0:15041:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff909247c41800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787583235.535625:0:15041:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc8b100 x1874416435905536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787583235.535652:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435905280:0@lo:400:kworker.0 00000100:00100000:2.0:1787583235.535652:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435905152:0@lo:400:kworker.0 00000100:00100000:0.0:1787583235.535718:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435905024:0@lo:400:kworker.0 00000100:00100000:3.0:1787583235.536820:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583235.536892:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787583235.536900:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435905664:0@lo:400:kworker.0 00000100:00100000:3.0:1787583235.536929:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583235.536966:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435905280 00000100:00100000:3.0:1787583235.536973:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435905280 00000100:00100000:3.0:1787583235.537015:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787583235.537023:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435905280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583235.537073:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435905280:12345-0@lo:400:kworker.0 Request processed in 50us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583235.537079:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787583235.537104:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435905664 00000100:00100000:3.0:1787583235.537107:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435905664 00000100:00100000:3.0:1787583235.537131:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787583235.537431:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435905664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583235.537468:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435905664:12345-0@lo:400:kworker.0 Request processed in 322us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583235.537475:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787583235.537515:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90937fc88000 x1874416435905664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583235.537528:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435905664:0@lo:400:kworker.0 00000100:00100000:3.0:1787583235.537540:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435905280:0@lo:400:kworker.0 00000100:00100000:3.0:1787583235.537567:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435905408:0@lo:8:kworker.0 00000400:00000100:3.0:1787583235.537602:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416435905408 offset 0 length 520: 4 00000100:00100000:3.0:1787583235.537624:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435905536:0@lo:8:kworker.0 00000400:00000100:3.0:1787583235.537641:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416435905536 offset 0 length 520: 4 00000100:00100000:1.0:1787583235.542600:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583235.542712:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435905152 00000100:00100000:2.0:1787583235.542722:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435905152 00000100:00100000:2.0:1787583235.542771:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787583235.542779:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435905152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583235.543031:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435905152:12345-0@lo:400:kworker.0 Request processed in 251us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583235.543039:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787583235.548150:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583235.548323:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435905024 00000100:00100000:0.0:1787583235.548342:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435905024 00000100:00100000:0.0:1787583235.548392:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787583235.548401:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435905024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583235.548464:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1874416435905024:12345-0@lo:400:kworker.0 Request processed in 65us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583235.548488:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787583235.548662:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435905024:0@lo:400:kworker.0 00010000:00080000:1.0:1787583235.560359:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90937fc8b480 x1874416435905152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583235.560379:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435905152:0@lo:400:kworker.0 00010000:00010000:1.0:1787583235.923259:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583236.560662:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435905792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787583236.560749:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583236.560814:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435905792 00000100:00100000:2.0:1787583236.560822:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435905792 00000100:00100000:2.0:1787583236.561264:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787583236.561276:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435905792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787583236.561317:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787583236.561373:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435905792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583236.561381:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787583236.561431:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435905792:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1787583236.563423:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787583236.563792:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787583236.563812:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435905920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583236.564165:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583236.564347:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435905920 00000100:00100000:1.0:1787583236.564354:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435905920 00000100:00100000:1.0:1787583236.564405:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787583236.564415:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435905920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787583236.564449:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787583236.564812:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435905920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 396us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583236.564819:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787583236.569246:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435905920:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787583236.944636:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583237.582454:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583222/real 1787583222] req@ffff909247f81c00 x1874416435896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583237.582484:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff909247f81c00 x1874416435896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583237.582494:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583222/real 1787583222] req@ffff909247f80e00 x1874416435896832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583237.582506:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff909247f80e00 x1874416435896832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787583237.582526:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909245b04000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787583237.582557:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787583237.582570:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435896704:0@lo:8:kworker.0 00000100:00080000:1.0:1787583237.582577:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909246692000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787583237.582581:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787583237.582585:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435896832:0@lo:8:kworker.0 00000100:00080000:1.0:1787583237.584256:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787583237.584261:0:15041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787583237.584264:0:15041:0:(import.c:65:import_set_state_nolock()) ffff909245b04000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787583237.584271:0:15041:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:1.0:1787583237.584276:0:15041:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787583237.584282:0:15041:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff909245b04000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583237.584302:0:15041:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909348843480 x1874416435906304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787583237.584315:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787583237.584318:0:15041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787583237.584320:0:15041:0:(import.c:65:import_set_state_nolock()) ffff909246692000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787583237.584323:0:15041:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:1.0:1787583237.584325:0:15041:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787583237.584327:0:15041:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff909246692000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583237.584335:0:15041:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909348840000 x1874416435906432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787583237.584360:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787583237.584363:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787583237.584365:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787583237.584375:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787583237.584404:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435906176:0@lo:400:kworker.0 00000100:00100000:1.0:1787583237.584468:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583237.584519:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787583237.584524:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435906048:0@lo:400:kworker.0 00000100:00100000:1.0:1787583237.584556:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583237.584587:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435906816:0@lo:400:kworker.0 00000100:00100000:1.0:1787583237.584610:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583237.584638:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435906560:0@lo:400:kworker.0 00000100:00100000:1.0:1787583237.584676:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583237.584692:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787583237.584697:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435906688:0@lo:400:kworker.0 00000100:00100000:1.0:1787583237.584726:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583237.584758:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435906176 00000100:00100000:1.0:1787583237.584764:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435906176 00000100:00100000:1.0:1787583237.584800:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435906688 00000100:00100000:1.0:1787583237.584803:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435906688 00000100:00100000:1.0:1787583237.584819:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787583237.584828:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435906176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583237.584912:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435906176:12345-0@lo:400:kworker.0 Request processed in 86us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583237.584920:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787583237.584935:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787583237.584941:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435906688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583237.584970:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435906688:12345-0@lo:400:kworker.0 Request processed in 30us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583237.584983:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787583237.585001:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435906048 00000100:00100000:1.0:1787583237.585005:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435906048 00000100:00100000:1.0:1787583237.585026:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787583237.585033:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+18:3656:x1874416435906048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583237.585063:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+18:3656:x1874416435906048:12345-0@lo:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583237.585069:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787583237.585095:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435906816 00000100:00100000:1.0:1787583237.585098:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435906816 00000100:00100000:1.0:1787583237.585119:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435906560 00000100:00100000:1.0:1787583237.585122:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435906560 00000100:00100000:1.0:1787583237.585136:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787583237.585142:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435906816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583237.585171:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435906816:12345-0@lo:400:kworker.0 Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583237.585177:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787583237.585186:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787583237.585193:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435906560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583237.585216:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435906560:12345-0@lo:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583237.585221:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787583237.585260:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435906688:0@lo:400:kworker.0 00010000:00080000:1.0:1787583237.585270:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff909348843800 x1874416435906560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583237.585280:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435906560:0@lo:400:kworker.0 00000100:00100000:1.0:1787583237.585309:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435906304:0@lo:8:kworker.0 00000400:00000100:1.0:1787583237.585335:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416435906304 offset 0 length 520: 4 00000100:00100000:1.0:1787583237.585354:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435906432:0@lo:8:kworker.0 00000400:00000100:1.0:1787583237.585373:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416435906432 offset 0 length 520: 4 00000100:00100000:1.0:1787583237.585399:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435906048:0@lo:400:kworker.0 00010000:00080000:1.0:1787583237.585410:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff909348840a80 x1874416435906816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583237.585419:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435906816:0@lo:400:kworker.0 00000100:00100000:1.0:1787583237.585427:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435906176:0@lo:400:kworker.0 00010000:00010000:1.0:1787583237.967080:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787583238.351520:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787583238.993936:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787583239.785358:0:18654:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787583239.785363:0:18654:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787583239.785364:0:18654:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787583239.785499:0:18654:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff909365f3c000 00000020:01000004:3.0:1787583239.785653:0:18654:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787583239.785667:0:18654:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787583239.785690:0:18654:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9093466119b8) 00000020:00000080:3.0:1787583239.785707:0:18654:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787583239.865452:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787583239.868564:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787583239.869202:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787583239.869737:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787583239.871070:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787583239.872613:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787583239.874788:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1787583239.881413:0:18654:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787583239.881632:0:18654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787583239.881967:0:18654:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787583239.881979:0:18654:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19a47956376b74c3 00000020:01000004:3.0:1787583239.881987:0:18654:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787583239.882008:0:18654:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787583239.882011:0:18654:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787583239.882016:0:18654:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787583239.882021:0:18654:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787583239.882032:0:18654:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff909346613370) 00000020:00000080:3.0:1787583239.882043:0:18654:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787583239.899602:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787583239.902004:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787583239.902021:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787583239.902977:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787583239.902985:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787583239.904069:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787583239.904078:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787583239.905385:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787583239.905578:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787583239.905584:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787583239.912222:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787583239.912734:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787583239.946459:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787583239.946708:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787583239.946714:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787583239.950810:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787583239.950835:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787583239.952213:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787583239.952223:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787583239.956670:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787583239.957049:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787583239.957057:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787583239.963115:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787583239.963136:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1787583240.016843:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583240.037221:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787583240.037428:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787583240.037435:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787583240.040716:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787583240.040728:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787583240.044217:0:18654:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787583240.044565:0:18654:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787583240.044572:0:18654:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787583240.091266:0:18654:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787583240.091336:0:18654:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787583240.091345:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787583240.091347:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787583240.091348:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787583240.091349:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787583240.091350:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787583240.091351:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787583240.091352:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787583240.091354:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787583240.091355:0:18654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787583240.091358:0:18654:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787583240.091360:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787583240.091361:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787583240.091362:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787583240.091363:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787583240.091364:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787583240.091365:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787583240.091366:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787583240.091367:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787583240.091367:0:18654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787583240.091393:0:18654:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787583240.091412:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435906944:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787583240.091477:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.091523:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936eeaeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787583240.091538:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435906944 00000100:00100000:0.0:1787583240.091556:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435906944 00000100:00100000:0.0:1787583240.091612:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787583240.091621:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+18:18654:x1874416435906944:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787583240.091661:0:17145:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787583240.091665:0:17145:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787583240.091669:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787583240.091991:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+18:18654:x1874416435906944:12345-0@lo:253:mount.lustre.0 Request processed in 369us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583240.091999:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787583240.092139:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435906944:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787583240.092149:0:18654:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787583240.092151:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787583240.092153:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787583240.092153:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787583240.092154:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787583240.092155:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787583240.092156:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787583240.092158:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787583240.092159:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787583240.092160:0:18654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787583240.092177:0:18654:0:(tgt_mount.c:101:server_register_mount()) register mount ffff909365f3c000 from lustre-OST0000 10000000:01000000:3.0:1787583240.092200:0:18654:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787583240.092203:0:18654:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787583240.092219:0:18654:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff909373fd99b8 local copy 00010000:00010000:3.0:1787583240.092229:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583240.092390:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583240.092421:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.092452:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936eeaeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787583240.092579:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435907072 00000100:00100000:0.0:1787583240.092584:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435907072 00000100:00100000:0.0:1787583240.092620:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787583240.092627:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:18654:x1874416435907072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787583240.092706:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+18:18654:x1874416435907072:12345-0@lo:501:mount.lustre.0 Request processed in 79us (284us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787583240.092713:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787583240.092884:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907072:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787583240.092898:0:18654:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787583240.092917:0:18654:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787583240.092923:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583240.092933:0:18654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583240.092973:0:18654:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff909365f3c000 10000000:01000000:1.0:1787583240.092977:0:18654:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787583240.092982:0:18654:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787583240.092985:0:18654:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787583240.092989:0:18654:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787583240.092992:0:18654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787583240.093011:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c53200/0x19a47956376b74d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583240.093019:0:18654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909247c53200/0x19a47956376b74d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583240.093027:0:18654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909247c53200/0x19a47956376b74d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583240.093051:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787583240.093078:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583240.093106:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787583240.093123:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435907200 00000100:00100000:0.0:1787583240.093133:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435907200 00000100:00100000:0.0:1787583240.093164:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787583240.093171:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+18:18654:x1874416435907200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583240.093179:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583240.093190:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713f400/0x19a47956376b74d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b74d1 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583240.093209:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713f400/0x19a47956376b74d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b74d1 expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583240.093218:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713f400/0x19a47956376b74d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b74d1 expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583240.093226:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f400, rc 0) 00000100:00100000:0.0:1787583240.093269:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+19:18654:x1874416435907200:12345-0@lo:101:mount.lustre.0 Request processed in 99us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583240.093275:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787583240.094046:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787583240.094062:0:18654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909247c53200/0x19a47956376b74d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b74d8 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583240.094072:0:18654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909247c53200/0x19a47956376b74d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b74d8 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787583240.095138:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787583240.096742:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787583240.105153:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787583240.105216:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787583240.105234:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787583240.105250:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787583240.105266:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787583240.105281:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787583240.105315:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787583240.105322:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787583240.105428:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583240.105492:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583240.105558:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583240.106121:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435907328 00000100:00100000:3.0:1787583240.106130:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435907328 00000100:00100000:3.0:1787583240.106228:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787583240.106238:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+19:18654:x1874416435907328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583240.106398:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+19:18654:x1874416435907328:12345-0@lo:501:mount.lustre.0 Request processed in 160us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583240.106405:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787583240.106504:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583240.106552:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787583240.106598:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583240.111126:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435907456 00000100:00100000:0.0:1787583240.111141:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435907456 00000100:00100000:1.0:1787583240.111175:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583240.111197:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787583240.111208:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+19:18654:x1874416435907456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787583240.113922:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+19:18654:x1874416435907456:12345-0@lo:503:mount.lustre.0 Request processed in 2707us (7315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583240.113935:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787583240.114117:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907456:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787583240.114491:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787583240.114575:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787583240.114620:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583240.114796:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435907584 00000100:00100000:2.0:1787583240.114803:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435907584 00000100:00100000:2.0:1787583240.114869:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787583240.114879:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909355335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+19:18654:x1874416435907584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787583240.115352:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936d9f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787583240.116137:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909355335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+19:18654:x1874416435907584:12345-0@lo:502:mount.lustre.0 Request processed in 1256us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583240.116146:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787583240.116244:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787583240.116472:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787583240.116500:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787583240.116530:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787583240.116566:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787583240.116583:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787583240.116598:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787583240.116612:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787583240.116625:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787583240.116637:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787583240.116915:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787583240.116934:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787583240.116945:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787583240.116973:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907712:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787583240.117014:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583240.117044:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787583240.117123:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435907712 00000100:00100000:1.0:1787583240.117129:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435907712 00000100:00100000:1.0:1787583240.117171:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787583240.117179:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909355335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+19:18654:x1874416435907712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787583240.117383:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909355335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+19:18654:x1874416435907712:12345-0@lo:502:mount.lustre.0 Request processed in 203us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583240.117395:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787583240.117469:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907712:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787583240.117503:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787583240.117510:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787583240.125110:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787583240.125122:0:18671:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787583240.125129:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583240.125131:0:18671:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787583240.125140:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787583240.125158:0:18671:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90936db219b8) 00000020:00000080:2.0:1787583240.125182:0:18671:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787583240.125188:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787583240.125325:0:18671:0:(tgt_mount.c:153:server_get_mount()) get mount ffff909365f3c000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787583240.125334:0:18671:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787583240.125341:0:18671:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19a47956376b74e6 00010000:00010000:2.0:1787583240.132391:0:18671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787583240.133417:0:18671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1787583240.136522:0:18671:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787583240.138401:0:18671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787583240.138412:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787583240.138418:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583240.138420:0:18671:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787583240.138424:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787583240.138426:0:18671:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787583240.138428:0:18671:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787583240.138429:0:18671:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787583240.138431:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787583240.138433:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583240.138434:0:18671:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787583240.138437:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787583240.138440:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583240.138441:0:18671:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787583240.138444:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787583240.138446:0:18671:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787583240.138449:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787583240.138451:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583240.138452:0:18671:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787583240.138454:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787583240.138457:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583240.138458:0:18671:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787583240.138461:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787583240.138485:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787583240.138489:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583240.138491:0:18671:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787583240.138494:0:18671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787583240.142971:0:18654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787583240.143018:0:18654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787583240.143037:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c53200/0x19a47956376b74d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b74d8 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.143050:0:18654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909247c53200/0x19a47956376b74d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b74d8 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583240.143058:0:18654:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff909365f3c000 from 1 10000000:01000000:3.0:1787583240.143061:0:18654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787583240.143095:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.143103:0:18654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.143125:0:18654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583240.143149:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787583240.143211:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.143247:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff909342a36780 going to sleep for 11 seconds 00000100:00100000:2.0:1787583240.144119:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435907840 00000100:00100000:2.0:1787583240.144129:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435907840 00000100:00100000:2.0:1787583240.145665:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787583240.145683:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+19:18654:x1874416435907840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787583240.145701:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583240.145721:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344dede00/0x19a47956376b74f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b74ed expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583240.145748:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344dede00/0x19a47956376b74f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b74ed expref: 20 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583240.145758:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344dede00/0x19a47956376b74f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b74ed expref: 20 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583240.145768:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dede00, rc 0) 00000100:00100000:2.0:1787583240.145839:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+20:18654:x1874416435907840:12345-0@lo:101:mount.lustre.0 Request processed in 163us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583240.145866:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787583240.145973:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787583240.145991:0:18654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b74f4 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.146002:0:18654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b74f4 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787583240.147483:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787583240.147779:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787583240.148001:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787583240.148026:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787583240.148045:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787583240.148051:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787583240.148119:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583240.148177:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.157201:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787583240.162403:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435907968 00000100:00100000:0.0:1787583240.162421:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435907968 00000100:00100000:0.0:1787583240.162487:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787583240.162497:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+20:18654:x1874416435907968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787583240.162679:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+20:18654:x1874416435907968:12345-0@lo:501:mount.lustre.0 Request processed in 183us (14501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583240.162687:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787583240.163060:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435907968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583240.163108:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787583240.163158:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.163192:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787583240.163473:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435908096 00000100:00100000:0.0:1787583240.163478:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435908096 00000100:00100000:0.0:1787583240.163502:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787583240.163509:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+20:18654:x1874416435908096:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787583240.163614:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+20:18654:x1874416435908096:12345-0@lo:503:mount.lustre.0 Request processed in 105us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583240.163631:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787583240.163932:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787583240.165139:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787583240.165237:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583240.165714:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.165757:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787583240.166409:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435908224 00000100:00100000:0.0:1787583240.166469:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435908224 00000100:00100000:0.0:1787583240.166510:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787583240.166534:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+20:18654:x1874416435908224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787583240.166674:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+20:18654:x1874416435908224:12345-0@lo:502:mount.lustre.0 Request processed in 143us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583240.166682:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787583240.166766:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787583240.167001:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787583240.167031:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787583240.167045:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787583240.167056:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787583240.167069:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787583240.167081:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787583240.167094:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787583240.167107:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787583240.167121:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787583240.167133:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787583240.167144:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787583240.167169:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583240.167207:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.167232:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787583240.170177:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435908352 00000100:00100000:2.0:1787583240.170193:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435908352 00000100:00100000:2.0:1787583240.170357:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787583240.170368:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+20:18654:x1874416435908352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787583240.171243:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+20:18654:x1874416435908352:12345-0@lo:502:mount.lustre.0 Request processed in 873us (4031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583240.171321:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787583240.176192:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787583240.176427:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787583240.176442:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787583240.180806:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787583240.180820:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583240.180822:0:18675:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787583240.180841:0:18675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff909365f3c000 00000020:00000080:0.0:1787583240.182489:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787583240.182505:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787583240.182510:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583240.182521:0:18675:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787583240.182525:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787583240.182528:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583240.182530:0:18675:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787583240.182534:0:18675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff909365f3c000 00000020:00000080:0.0:1787583240.182536:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787583240.182598:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787583240.182601:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583240.182603:0:18675:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787583240.182605:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787583240.182608:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583240.182609:0:18675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787583240.182612:0:18675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff909365f3c000 00000020:00000080:0.0:1787583240.182614:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787583240.182631:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787583240.182644:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583240.182645:0:18675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787583240.182648:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787583240.182650:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583240.182652:0:18675:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787583240.182655:0:18675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff909365f3c000 00000020:00000080:0.0:1787583240.182657:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787583240.182691:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787583240.182693:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787583240.182695:0:18675:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787583240.182698:0:18675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1787583240.183038:0:18654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787583240.183069:0:18654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787583240.183086:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b74f4 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.183109:0:18654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b74f4 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583240.183158:0:18654:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787583240.183161:0:18654:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff909365f3c000 10000000:01000000:3.0:1787583240.183164:0:18654:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff909365f3c000 10000000:01000000:3.0:1787583240.183168:0:18654:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787583240.183173:0:18654:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff909365f3c000 from 1 10000000:01000000:3.0:1787583240.183176:0:18654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787583240.183208:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909248497c00/0x19a47956376b74fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.183217:0:18654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909248497c00/0x19a47956376b74fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.183228:0:18654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909248497c00/0x19a47956376b74fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583240.183324:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787583240.183388:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.183431:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787583240.188403:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435908480 00000100:00100000:0.0:1787583240.188417:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435908480 00000100:00100000:0.0:1787583240.188478:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787583240.188489:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+20:18654:x1874416435908480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583240.188506:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583240.188537:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713e000/0x19a47956376b7502 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b74fb expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583240.188574:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713e000/0x19a47956376b7502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b74fb expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583240.188585:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713e000/0x19a47956376b7502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b74fb expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583240.188593:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713e000, rc 0) 00000100:00100000:0.0:1787583240.188925:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435908480:12345-0@lo:101:mount.lustre.0 Request processed in 436us (5535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583240.188933:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787583240.189453:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787583240.189472:0:18654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909248497c00/0x19a47956376b74fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7502 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.189483:0:18654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909248497c00/0x19a47956376b74fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7502 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787583240.192992:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787583240.193276:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787583240.193453:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787583240.193476:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787583240.193488:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787583240.193501:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787583240.193513:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787583240.193525:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787583240.193539:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787583240.193562:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787583240.193575:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787583240.193587:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787583240.193599:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787583240.193611:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787583240.193623:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787583240.193648:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787583240.193663:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787583240.193689:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787583240.193702:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787583240.193713:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787583240.193725:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787583240.193735:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787583240.193746:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787583240.193757:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787583240.193769:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787583240.193781:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787583240.193793:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1787583240.193804:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1787583240.193817:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1787583240.193842:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1787583240.193888:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1787583240.193910:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1787583240.193923:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1787583240.193945:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1787583240.193958:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1787583240.193970:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1787583240.193982:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1787583240.193993:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1787583240.194005:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1787583240.194023:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1787583240.194028:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787583240.194102:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583240.194166:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.194208:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473000 going to sleep for 11 seconds 00000100:00100000:2.0:1787583240.194929:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435908608 00000100:00100000:2.0:1787583240.194938:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435908608 00000100:00100000:2.0:1787583240.194983:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787583240.194992:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d914850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435908608:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787583240.195118:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d914850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435908608:12345-0@lo:501:mount.lustre.0 Request processed in 127us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583240.195126:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787583240.196660:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583240.196711:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787583240.196768:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.196804:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435908736 00000100:00100000:3.0:1787583240.196810:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435908736 00000100:00100000:3.0:1787583240.198717:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787583240.198737:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d915850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435908736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787583240.201658:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d915850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435908736:12345-0@lo:503:mount.lustre.0 Request processed in 2921us (4881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583240.201672:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787583240.201761:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473000 going to sleep for 11 seconds 00000100:00100000:3.0:1787583240.201786:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908736:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787583240.202205:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787583240.202278:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583240.202330:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.202357:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787583240.202375:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435908864 00000100:00100000:3.0:1787583240.202381:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435908864 00000100:00100000:3.0:1787583240.202414:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787583240.202421:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435908864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583240.202510:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435908864:12345-0@lo:502:mount.lustre.0 Request processed in 87us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583240.202517:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787583240.202571:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787583240.202735:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787583240.202759:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787583240.202773:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787583240.202783:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787583240.202794:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787583240.202804:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787583240.202820:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787583240.202870:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787583240.202888:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787583240.202900:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787583240.202911:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787583240.202923:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787583240.202935:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787583240.202948:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787583240.202961:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787583240.202974:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787583240.202987:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787583240.202999:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787583240.203011:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787583240.203034:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787583240.203047:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787583240.203059:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787583240.203071:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787583240.203096:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787583240.203110:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1787583240.203122:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1787583240.203134:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1787583240.203147:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1787583240.203159:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1787583240.203171:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1787583240.203182:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1787583240.203194:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1787583240.203206:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1787583240.203219:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1787583240.203232:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1787583240.203244:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1787583240.203257:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1787583240.203272:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1787583240.203285:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1787583240.203312:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1787583240.203327:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1787583240.203340:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1787583240.203352:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1787583240.203366:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1787583240.203377:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1787583240.203389:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1787583240.203401:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1787583240.203414:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1787583240.203450:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583240.203495:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.203530:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435908992 00000100:00100000:3.0:1787583240.207125:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435908992 00000100:00100000:3.0:1787583240.207194:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787583240.207205:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d917450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435908992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583240.207417:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d917450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435908992:12345-0@lo:502:mount.lustre.0 Request processed in 213us (3920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583240.207425:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787583240.207478:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787583240.207501:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435908992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787583240.207756:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1787583240.207782:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1787583240.207815:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435909120:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583240.208444:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.208522:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246473a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787583240.220667:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435909120 00000100:00100000:2.0:1787583240.220681:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435909120 00000100:00100000:2.0:1787583240.220924:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787583240.220937:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d917c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435909120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787583240.221101:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d917c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435909120:12345-0@lo:502:mount.lustre.0 Request processed in 167us (12657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583240.221109:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787583240.221360:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435909120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787583240.221434:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1787583240.221447:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787583240.225157:0:18680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787583240.225174:0:18680:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff909346614d28) 00000020:00000080:3.0:1787583240.225197:0:18680:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1787583240.225425:0:18680:0:(tgt_mount.c:153:server_get_mount()) get mount ffff909365f3c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787583240.225430:0:18680:0:(tgt_mount.c:187:server_put_mount()) put mount ffff909365f3c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787583240.225432:0:18680:0:(obd_mount.c:710:lustre_put_lsi()) put ffff909365f3c000 3 00010000:00080000:3.0:1787583240.225460:0:18680:0:(ldlm_lib.c:102:import_set_conn()) imp ffff909352904000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1787583240.228467:0:18680:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1787583240.229550:0:18680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787583240.229596:0:18680:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787583240.229610:0:18680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x19a47956376b7510 00000100:00080000:3.0:1787583240.229626:0:18680:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787583240.229632:0:18680:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff909352904000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787583240.229674:0:18680:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc88000 x1874416435909248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787583240.229700:0:18680:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787583240.229727:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874416435909248:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787583240.229736:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583240.229740:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583240.229742:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583240.229745:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583240.229766:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583240.229769:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583240.229771:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583240.229773:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787583240.229798:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435909760:0@lo:400:kworker.0 00000100:00100000:1.0:1787583240.230395:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583240.230456:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435909376:0@lo:400:kworker.0 00000100:00100000:1.0:1787583240.230484:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583240.230553:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435909504:0@lo:400:kworker.0 00000100:00100000:1.0:1787583240.230576:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583240.230593:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787583240.230599:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435909632:0@lo:400:kworker.0 00000100:00100000:1.0:1787583240.230618:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583240.230723:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435909248 00000100:00100000:1.0:1787583240.230730:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435909248 00000100:00100000:3.0:1787583240.230739:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.230772:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435909504 00000100:00100000:3.0:1787583240.230776:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435909504 00000100:00100000:3.0:1787583240.230796:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435909760 00000100:00100000:3.0:1787583240.230798:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435909760 00000100:00100000:3.0:1787583240.230811:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787583240.230819:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435909504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583240.230827:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787583240.230834:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787583240.230872:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435909376 00000100:00100000:1.0:1787583240.230876:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435909376 00000100:00100000:1.0:1787583240.230897:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435909632 00000100:00100000:1.0:1787583240.230900:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435909632 00000100:00100000:1.0:1787583240.230914:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787583240.230919:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435909376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583240.230950:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435909504:12345-0@lo:400:kworker.0 Request processed in 131us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583240.230950:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435909376:12345-0@lo:400:kworker.0 Request processed in 30us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583240.230958:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787583240.230958:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787583240.230972:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787583240.230975:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787583240.230977:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435909632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583240.230979:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435909760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583240.231003:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435909760:12345-0@lo:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583240.231003:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435909632:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583240.231009:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787583240.231009:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787583240.231021:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787583240.231025:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874416435909248:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787583240.231025:0:17155:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00010000:00080000:3.0:1787583240.231043:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:3.0:1787583240.231078:0:17154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x19a47956376b7517 00000004:00100000:3.0:1787583240.231093:0:17154:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787583240.231120:0:17154:0:(import.c:65:import_set_state_nolock()) ffff90937fbe1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787583240.231154:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874416435909248:12345-0@lo:38:llog_process_th.0 Request processed in 128us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583240.231157:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435909376:0@lo:400:kworker.0 00000100:00100000:3.0:1787583240.231160:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787583240.231183:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90937fc8b480 x1874416435909760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787583240.231183:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90937fc88000 x1874416435909248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787583250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583240.231193:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1787583240.231194:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435909760:0@lo:400:kworker.0 00000100:00080000:1.0:1787583240.231204:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787583240.231211:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787583240.231215:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787583240.231217:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909352904000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787583240.231223:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874416435909248:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787583240.231396:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435909632:0@lo:400:kworker.0 00010000:00080000:1.0:1787583240.231406:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90937fc88380 x1874416435909504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583240.231414:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435909504:0@lo:400:kworker.0 00000020:01000004:3.0:1787583240.234029:0:18680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787583240.234044:0:18680:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff909346610000) 00000020:00000080:3.0:1787583240.234065:0:18680:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1787583240.235246:0:18680:0:(tgt_mount.c:153:server_get_mount()) get mount ffff909365f3c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787583240.235321:0:18680:0:(tgt_mount.c:187:server_put_mount()) put mount ffff909365f3c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787583240.235324:0:18680:0:(obd_mount.c:710:lustre_put_lsi()) put ffff909365f3c000 3 00010000:00080000:3.0:1787583240.235356:0:18680:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90937fbe2800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1787583240.242170:0:18680:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1787583240.243020:0:18680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1787583240.243067:0:18680:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787583240.243080:0:18680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x19a47956376b7525 00000100:00080000:3.0:1787583240.243090:0:18680:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787583240.243095:0:18680:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90937fbe2800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787583240.243137:0:18680:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc8b480 x1874416435909888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787583240.243163:0:18680:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787583240.243188:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583240.243192:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583240.243195:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583240.243197:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583240.243201:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583240.243204:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583240.243206:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583240.243209:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787583240.243350:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874416435909888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787583240.243417:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787583240.244153:0:18680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1787583240.244233:0:18654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787583240.244276:0:18654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787583240.244291:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909248497c00/0x19a47956376b74fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7502 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583240.244303:0:18654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909248497c00/0x19a47956376b74fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7502 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787583240.244354:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787583240.244357:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787583240.244358:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787583240.244359:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787583240.244360:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787583240.244362:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787583240.244363:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787583240.244365:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787583240.244366:0:18654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787583240.244370:0:18654:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787583240.244372:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787583240.244374:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787583240.244375:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787583240.244376:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787583240.244377:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787583240.244378:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787583240.244379:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787583240.244380:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787583240.244381:0:18654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787583240.244398:0:18654:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787583240.244411:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435910016:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787583240.244450:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583240.244478:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435910016 00000100:00100000:2.0:1787583240.244484:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435910016 00000100:00100000:2.0:1787583240.244533:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787583240.244551:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435910016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787583240.244583:0:17148:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787583240.244596:0:17148:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787583240.245951:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092467733c0 going to sleep for 11 seconds 20000000:01000000:3.0:1787583240.246432:0:17148:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787583240.246449:0:17148:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787583240.246567:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435909888 00000100:00100000:1.0:1787583240.246575:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435909888 00000100:00100000:1.0:1787583240.246611:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787583240.246618:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874416435909888:12345-0@lo:38:llog_process_th.0 20000000:01000000:2.0:1787583240.246682:0:17169:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787583240.246687:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787583240.246705:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787583240.246711:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 547 last 0 00010000:00010000:2.0:1787583240.246719:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909248497400/0x19a47956376b747d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7476 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583240.246726:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909344ded000/0x19a47956376b748b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7484 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583240.246733:0:17169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787583240.246743:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x19a47956376b7533 00010000:00010000:2.0:1787583240.246763:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909344ded000/0x19a47956376b748b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b7484 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583240.246777:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff909344ded000/0x19a47956376b748b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b7484 expref: 21 pid: 17147 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583240.246788:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435910144:0@lo:104: 00000004:00100000:1.0:1787583240.246823:0:17155:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787583240.246865:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787583240.246877:0:17155:0:(import.c:65:import_set_state_nolock()) ffff909247c58800 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1787583240.246901:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909248497400/0x19a47956376b747d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b7476 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583240.246909:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff909248497400/0x19a47956376b747d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b7476 expref: 21 pid: 17147 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583240.246927:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874416435909888:12345-0@lo:38:llog_process_th.0 Request processed in 308us (3510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583240.246928:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435910272:0@lo:104: 00000100:00100000:1.0:1787583240.246933:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787583240.246950:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583240.246966:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092464736c0 going to sleep for 11 seconds 00010000:00080000:1.0:1787583240.246977:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90937fc8b480 x1874416435909888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787583250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583240.246987:0:17136:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787583240.246988:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787583240.246995:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00100000:2.0:1787583240.246997:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435910144 00000100:00100000:2.0:1787583240.247000:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435910144 00000100:00080000:1.0:1787583240.247007:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787583240.247011:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787583240.247013:0:3652:0:(import.c:65:import_set_state_nolock()) ffff90937fbe2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787583240.247018:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435910272 00000100:00100000:1.0:1787583240.247019:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874416435909888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787583240.247020:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435910272 00000100:00100000:2.0:1787583240.247029:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787583240.247035:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+4:17169:x1874416435910144:12345-0@lo:104: 00010000:00010000:2.0:1787583240.247045:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b748b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583240.247088:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787583240.247094:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+4:17169:x1874416435910144:12345-0@lo:104: Request processed in 60us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583240.247099:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787583240.247111:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787583240.247117:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092477ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+3:17169:x1874416435910272:12345-0@lo:104: 00010000:00010000:2.0:1787583240.247124:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b747d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583240.247150:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787583240.247155:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092477ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+3:17169:x1874416435910272:12345-0@lo:104: Request processed in 39us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583240.247160:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787583240.247315:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787583240.247322:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b748b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247330:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1787583240.247334:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b748b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247352:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b748b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787583240.247359:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b748b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583240.247365:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787583240.247389:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b748b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247395:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787583240.247409:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b748b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247416:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924713fc00/0x19a47956376b7484 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b748b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247426:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583240.247429:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b747d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247434:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1787583240.247437:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b747d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247443:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b747d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787583240.247448:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b747d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583240.247458:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787583240.247469:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b747d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247474:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787583240.247487:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b747d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247494:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924713f000/0x19a47956376b7476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b747d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247505:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583240.247507:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583240.247508:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583240.247538:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435910400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787583240.247575:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.247604:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435910528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787583240.247624:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583240.247652:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435910400 00000100:00100000:3.0:1787583240.247656:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435910400 00010000:00010000:3.0:1787583240.247672:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909344ded000/0x19a47956376b748b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b7484 expref: 22 pid: 17147 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583240.247688:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435910528 00000100:00100000:3.0:1787583240.247691:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435910528 00010000:00010000:3.0:1787583240.247699:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909248497400/0x19a47956376b747d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b7476 expref: 23 pid: 17147 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583240.247709:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787583240.247720:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea761437-c095-48a5-91f7-0c431111ca6a+23:3656:x1874416435910400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787583240.247729:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583240.247734:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909344ded000/0x19a47956376b748b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b7484 expref: 23 pid: 17147 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247743:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909344ded000/0x19a47956376b748b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b7484 expref: 23 pid: 17147 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247756:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583240.247779:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea761437-c095-48a5-91f7-0c431111ca6a+23:3656:x1874416435910400:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583240.247785:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787583240.247797:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787583240.247802:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909343866050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea761437-c095-48a5-91f7-0c431111ca6a+22:3653:x1874416435910528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787583240.247808:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583240.247812:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909248497400/0x19a47956376b747d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b7476 expref: 22 pid: 17147 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247820:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909248497400/0x19a47956376b747d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b7476 expref: 22 pid: 17147 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247842:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247869:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787583240.247882:0:17140:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013455151s 00010000:00010000:3.0:1787583240.247886:0:17140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247897:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247903:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247908:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247914:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344ded800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583240.247918:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247925:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247934:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583240.247942:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583240.247966:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909343866050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea761437-c095-48a5-91f7-0c431111ca6a+22:3653:x1874416435910528:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583240.247972:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787583240.248018:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435910528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787583240.248034:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435910400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787583240.248455:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+21:18654:x1874416435910016:12345-0@lo:253:mount.lustre.0 Request processed in 3913us (4003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583240.248468:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:1.0:1787583240.248609:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344ded000/0x19a47956376b748b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b7484 expref: 20 pid: 17147 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583240.248619:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435910144:0@lo:104: 00000100:00100000:3.0:1787583240.248621:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:18654:1874416435910016:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1787583240.248628:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909248497400/0x19a47956376b747d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b7476 expref: 19 pid: 17147 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583240.248632:0:18654:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000100:00100000:1.0:1787583240.248637:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435910272:0@lo:104: 00000020:01000004:3.0:1787583240.248639:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787583240.248641:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787583240.248642:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787583240.248643:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787583240.248645:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787583240.248646:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787583240.248647:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787583240.248649:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787583240.248650:0:18654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1787583240.248651:0:17169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583240.248659:0:17169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1787583240.248661:0:18654:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787583240.248665:0:17169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583240.248670:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344ded800/0x19a47956376b752c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583240.248687:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787583240.251509:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787583240.266107:0:18654:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787583240.266116:0:18654:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787583240.266210:0:18654:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787583240.266279:0:18654:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787583240.266296:0:18654:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787583240.266314:0:18654:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787583240.266992:0:18654:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787583240.267177:0:18654:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787583241.045601:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787583241.422467:0:18735:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787583241.422768:0:18735:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787583241.678041:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787583241.678064:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435910656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583241.678127:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583241.680212:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787583241.680231:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435910784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583241.683772:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583241.685130:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435910656 00000100:00100000:2.0:1787583241.685148:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435910784 00000100:00100000:2.0:1787583241.685158:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435910784 00000100:00100000:0.0:1787583241.685159:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435910656 00000100:00100000:2.0:1787583241.685205:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787583241.685216:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435910784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787583241.685251:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787583241.685322:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435910784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583241.685329:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787583241.685464:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787583241.685473:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435910656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787583241.685490:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787583241.685528:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435910656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (7402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583241.685549:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787583241.685628:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435910784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583241.685663:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435910656:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1787583241.742386:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787583241.742393:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90935822f800 from 9 10000000:01000000:2.0:1787583241.742398:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787583241.742455:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583241.742467:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583241.742478:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583241.742502:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435910912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787583241.742589:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583241.742628:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365f11cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583241.742628:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435910912 00000100:00100000:0.0:1787583241.742637:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435910912 00000100:00100000:0.0:1787583241.742760:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787583241.742770:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+19:17151:x1874416435910912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787583241.742782:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583241.743456:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713fc00/0x19a47956376b7541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b753a expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583241.743480:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713fc00/0x19a47956376b7541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b753a expref: 20 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583241.743490:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713fc00/0x19a47956376b7541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b753a expref: 20 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583241.743499:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fc00, rc 0) 00000100:00100000:0.0:1787583241.743558:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+20:17151:x1874416435910912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 789us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583241.743565:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787583241.749072:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435910912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583241.749116:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7541 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583241.749128:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7541 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583241.749196:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435911040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787583241.749259:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583241.749307:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365f11cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583241.750313:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435911040 00000100:00100000:1.0:1787583241.750323:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435911040 00000100:00100000:1.0:1787583241.750382:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787583241.750392:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d915c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+20:17151:x1874416435911040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787583241.750413:0:17148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787583241.750433:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787583241.750437:0:17148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787583241.750566:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d915c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+20:17151:x1874416435911040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 175us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583241.750574:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787583241.750834:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435911040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787583241.750913:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787583241.750922:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7541 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583241.750931:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7541 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583241.750941:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787583241.750944:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff909248438000 from 9 10000000:01000000:2.0:1787583241.750946:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787583241.750971:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583241.750979:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583241.750988:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583241.751014:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435911168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787583241.751044:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583241.751066:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365f11cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583241.751301:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435911168 00000100:00100000:1.0:1787583241.751305:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435911168 00000100:00100000:1.0:1787583241.751341:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787583241.751350:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+20:17151:x1874416435911168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583241.751359:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583241.751371:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909247c52600/0x19a47956376b754f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b7548 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583241.751391:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909247c52600/0x19a47956376b754f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b7548 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583241.751400:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909247c52600/0x19a47956376b754f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7548 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583241.751409:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52600, rc 0) 00000100:00100000:1.0:1787583241.751445:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+21:17151:x1874416435911168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583241.751451:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787583241.751512:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435911168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583241.751524:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b754f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583241.751542:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b754f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583241.751582:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435911296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787583241.751610:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583241.751632:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365f11cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583241.752929:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435911296 00000100:00100000:1.0:1787583241.752938:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435911296 00000100:00100000:1.0:1787583241.752990:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787583241.752999:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d915050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+21:17151:x1874416435911296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787583241.753019:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787583241.753037:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787583241.753040:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787583241.753155:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d915050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+21:17151:x1874416435911296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583241.753163:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787583241.753351:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435911296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787583241.753406:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787583241.753414:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b754f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583241.753424:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b754f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583242.063204:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583243.104802:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583244.111137:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787583244.559461:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787583245.135154:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787583245.262220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583245.262227:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583245.262230:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583245.262233:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583245.262250:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583245.262253:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787583245.262255:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787583245.262266:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787583245.262322:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435911680:0@lo:400:kworker.0 00000100:00100000:3.0:1787583245.262388:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583245.262444:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435912192:0@lo:400:kworker.0 00000100:00100000:2.0:1787583245.262554:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435911424:0@lo:400:kworker.0 00000100:00100000:2.0:1787583245.262589:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583245.262624:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435911936:0@lo:400:kworker.0 00000100:00100000:2.0:1787583245.262646:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583245.262671:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787583245.262677:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435911808:0@lo:400:kworker.0 00000100:00100000:2.0:1787583245.262701:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583245.262732:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435911424 00000100:00100000:2.0:1787583245.262739:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435911424 00000100:00100000:2.0:1787583245.262779:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787583245.262787:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+21:3656:x1874416435911424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583245.262834:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+21:3656:x1874416435911424:12345-0@lo:400:kworker.0 Request processed in 47us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583245.262841:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787583245.262907:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435911424:0@lo:400:kworker.0 00000100:00100000:3.0:1787583245.263011:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583245.263040:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787583245.263046:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435911552:0@lo:400:kworker.0 00000100:00100000:3.0:1787583245.263071:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583245.263086:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435912064:0@lo:400:kworker.0 00000100:00100000:3.0:1787583245.263106:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583245.263129:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435911680 00000100:00100000:3.0:1787583245.263133:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435911680 00000100:00100000:3.0:1787583245.263153:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435911936 00000100:00100000:3.0:1787583245.263156:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435911936 00000100:00100000:3.0:1787583245.263165:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435912192 00000100:00100000:3.0:1787583245.263168:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435912192 00000100:00100000:3.0:1787583245.263184:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435912064 00000100:00100000:3.0:1787583245.263186:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435912064 00000100:00100000:3.0:1787583245.263199:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787583245.263205:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435911680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583245.263240:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874416435911680:12345-0@lo:400:kworker.0 Request processed in 34us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583245.263246:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787583245.263259:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787583245.263265:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435911936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583245.263293:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874416435911936:12345-0@lo:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583245.263307:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787583245.263321:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787583245.263327:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435912192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583245.263356:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874416435912192:12345-0@lo:400:kworker.0 Request processed in 30us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583245.263362:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787583245.263373:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787583245.263379:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435912064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583245.263403:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435912064:12345-0@lo:400:kworker.0 Request processed in 24us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583245.263409:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787583245.263437:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787583245.263441:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787583245.263724:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435911808 00000100:00100000:0.0:1787583245.263729:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435911808 00000100:00100000:0.0:1787583245.263761:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435911552 00000100:00100000:0.0:1787583245.263764:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435911552 00000100:00100000:0.0:1787583245.263790:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787583245.263795:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435911808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583245.263835:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435911808:12345-0@lo:400:kworker.0 Request processed in 39us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583245.263841:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787583245.263877:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787583245.263884:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435911552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583245.263911:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435911552:12345-0@lo:400:kworker.0 Request processed in 29us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583245.263917:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787583245.264139:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435911808:0@lo:400:kworker.0 00010000:00080000:2.0:1787583245.264152:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90937fc88000 x1874416435911936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583245.264161:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874416435911936:0@lo:400:kworker.0 00010000:00080000:3.0:1787583245.264208:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90937fc8aa00 x1874416435912064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583245.264218:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435912064:0@lo:400:kworker.0 00010000:00080000:3.0:1787583245.264234:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90937fc88380 x1874416435911680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583245.264243:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874416435911680:0@lo:400:kworker.0 00010000:00080000:3.0:1787583245.264253:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90937fc88a80 x1874416435912192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583245.264261:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874416435912192:0@lo:400:kworker.0 00000100:00100000:3.0:1787583245.264281:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435911552:0@lo:400:kworker.0 00010000:00010000:2.0:1787583246.158019:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787583246.663229:0:19025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787583246.809558:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435912320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583246.809635:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583246.809728:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435912320 00000100:00100000:0.0:1787583246.809736:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435912320 00000100:00100000:0.0:1787583246.809795:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787583246.809805:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435912320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787583246.809837:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787583246.809908:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435912320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583246.809915:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787583246.810053:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435912320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583246.810440:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435912448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583246.810473:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583246.810714:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435912448 00000100:00100000:0.0:1787583246.810719:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435912448 00000100:00100000:0.0:1787583246.810757:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787583246.810765:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435912448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787583246.810810:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787583246.810878:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435912448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583246.810885:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787583246.812322:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435912448:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787583247.185206:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787583247.561668:0:19077:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787583247.561960:0:19077:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787583248.213397:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787583248.350609:0:19127:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787583248.350898:0:19127:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1787583248.590804:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787583249.231010:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583250.261119:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787583250.382996:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787583250.383004:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787583250.383006:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787583250.383010:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787583250.383042:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787583250.383046:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787583250.383049:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787583250.383051:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787583250.383102:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435912576:0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.383191:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583250.383249:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435913088:0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.383278:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583250.383309:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787583250.383315:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435912704:0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.383340:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583250.383360:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435913216:0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.383383:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583250.383414:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435912832:0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.383435:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583250.383451:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435913344:0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.383498:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583250.383519:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787583250.383524:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435912960:0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.383545:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583250.383577:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435912576 00000100:00100000:0.0:1787583250.383585:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435912576 00000100:00100000:0.0:1787583250.383632:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787583250.383641:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d916450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+21:3653:x1874416435912576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.383701:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d916450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+21:3653:x1874416435912576:12345-0@lo:400:kworker.0 Request processed in 60us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583250.383707:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787583250.383739:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435913088 00000100:00100000:0.0:1787583250.383743:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435913088 00000100:00100000:0.0:1787583250.383771:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435913216 00000100:00100000:0.0:1787583250.383774:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435913216 00000100:00100000:0.0:1787583250.383795:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435912832 00000100:00100000:0.0:1787583250.383799:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435912832 00000100:00100000:0.0:1787583250.383808:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435913344 00000100:00100000:0.0:1787583250.383811:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435913344 00000100:00100000:0.0:1787583250.383825:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787583250.383831:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435913088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.383887:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435913088:12345-0@lo:400:kworker.0 Request processed in 56us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583250.383894:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787583250.383906:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787583250.383912:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435913216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.383940:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435913216:12345-0@lo:400:kworker.0 Request processed in 29us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583250.383956:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787583250.383969:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787583250.383975:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435912832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.384009:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435912832:12345-0@lo:400:kworker.0 Request processed in 34us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583250.384014:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787583250.384028:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787583250.384033:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435913344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.384059:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435913344:12345-0@lo:400:kworker.0 Request processed in 26us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583250.384064:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787583250.384085:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435912704 00000100:00100000:0.0:1787583250.384089:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435912704 00000100:00100000:0.0:1787583250.384109:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435912960 00000100:00100000:0.0:1787583250.384112:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435912960 00000100:00100000:0.0:1787583250.384127:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787583250.384132:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435912704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.384164:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435912704:12345-0@lo:400:kworker.0 Request processed in 31us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583250.384171:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787583250.384183:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787583250.384189:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435912960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.384214:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435912960:12345-0@lo:400:kworker.0 Request processed in 26us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583250.384220:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787583250.384259:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787583250.384264:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787583250.384295:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435912960:0@lo:400:kworker.0 00010000:00080000:0.0:1787583250.384309:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ef4e00 x1874416435912832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583250.384320:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435912832:0@lo:400:kworker.0 00010000:00080000:0.0:1787583250.384330:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ef7480 x1874416435913344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583250.384339:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435913344:0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.384371:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435912704:0@lo:400:kworker.0 00010000:00080000:0.0:1787583250.384380:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ef7100 x1874416435913216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583250.384389:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435913216:0@lo:400:kworker.0 00000100:00100000:0.0:1787583250.384397:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435912576:0@lo:400:kworker.0 00010000:00080000:0.0:1787583250.384405:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ef4380 x1874416435913088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583250.384413:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435913088:0@lo:400:kworker.0 00000100:00100000:1.0:1787583250.509928:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583235/real 1787583235] req@ffff90937fc88700 x1874416435905408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583250 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583250.509960:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90937fc88700 x1874416435905408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583250 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583250.509971:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583235/real 1787583235] req@ffff90937fc8b100 x1874416435905536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583250 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583250.509983:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90937fc8b100 x1874416435905536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583250 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787583250.510001:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909348746000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787583250.510032:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787583250.510036:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435905408:0@lo:8:kworker.0 00000100:00080000:1.0:1787583250.510043:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909247c41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787583250.510048:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787583250.510051:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435905536:0@lo:8:kworker.0 00000100:00080000:1.0:1787583250.510087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787583250.510092:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787583250.510095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787583250.510098:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787583250.510101:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787583250.510104:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787583250.510108:0:36:0:(import.c:65:import_set_state_nolock()) ffff909348746000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787583250.510112:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:1.0:1787583250.510117:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787583250.510124:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff909348746000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583250.510153:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247ec9500 x1874416435913472/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787583250.510171:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787583250.510174:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787583250.510176:0:36:0:(import.c:65:import_set_state_nolock()) ffff909247c41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787583250.510179:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:1.0:1787583250.510181:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787583250.510184:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff909247c41800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583250.510201:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247ecb100 x1874416435913600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787583250.510225:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435913472:0@lo:8:kworker.0 00000100:00100000:1.0:1787583250.510288:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583250.510334:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435913600:0@lo:8:kworker.0 00000100:00100000:1.0:1787583250.510360:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583250.510621:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435913472 00000100:00100000:3.0:1787583250.510630:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435913472 00000100:00100000:3.0:1787583250.510655:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435913600 00000100:00100000:3.0:1787583250.510657:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435913600 00000100:00100000:3.0:1787583250.510668:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787583250.510675:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874416435913472:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787583250.510702:0:18659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:3.0:1787583250.510730:0:18659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b7556 00002000:00100000:3.0:1787583250.510742:0:18659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff909377ef1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787583250.510745:0:18659:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787583250.510748:0:18659:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787583250.511835:0:18659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787583250.511886:0:18659:0:(import.c:65:import_set_state_nolock()) ffff909351803000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787583250.512164:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1874416435913472:12345-0@lo:8:kworker.0 Request processed in 1486us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583250.512174:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787583250.512200:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787583250.512206:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874416435913600:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787583250.512222:0:18659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1787583250.512315:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ec9500 x1874416435913472/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787583270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583250.512327:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787583250.512334:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787583250.512342:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787583250.512355:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787583250.512358:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909348746000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787583250.512390:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787583250.512396:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435913472:0@lo:8:kworker.0 00000004:00080000:2.0:1787583250.512605:0:17895:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787583250.512686:0:17895:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 557665839652ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787583250.512693:0:17895:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1787583250.526046:0:17896:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787583250.526077:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17896:1874416435913856:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787583250.526153:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583250.526192:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365c8ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787583250.526211:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435913728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787583250.526236:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583250.531546:0:18660:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787583250.531566:0:18660:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787583250.531604:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435913728 00000100:00100000:1.0:1787583250.531614:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435913728 00000100:00100000:1.0:1787583250.531696:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787583250.531708:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3656:x1874416435913728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787583250.531738:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787583250.531831:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3656:x1874416435913728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (5593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583250.531838:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787583250.532388:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874416435913600:12345-0@lo:8:kworker.0 Request processed in 20178us (22024us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787583250.532408:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787583250.532455:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909247c41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787583250.532461:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787583250.532476:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435913600:0@lo:8:kworker.0 00000100:00100000:3.0:1787583250.532505:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435913856 00000100:00100000:3.0:1787583250.532510:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435913856 00000100:00100000:3.0:1787583250.532541:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787583250.532549:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17896:x1874416435913856:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:2.0:1787583250.534491:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90937fceb100 x1874416435913728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583250.534521:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435913728:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787583250.534532:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1787583250.538127:0:18659:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787583250.538136:0:18659:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787583250.538241:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17896:x1874416435913856:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5687us (12093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583250.538252:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787583250.538508:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90937fce9500 x1874416435913856/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787583266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583250.538524:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17896:1874416435913856:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787583250.538537:0:17896:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787583250.538580:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17896:1874416435913984:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787583250.538590:0:17886:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787583250.538628:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583250.538665:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a1d59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583250.538782:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435913984 00000100:00100000:0.0:1787583250.538790:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435913984 00000100:00100000:0.0:1787583250.538842:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787583250.538875:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17896:x1874416435913984:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787583250.538903:0:18661:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1787583250.539122:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17896:x1874416435913984:12345-0@lo:5:osp-pre-0-1.0 Request processed in 248us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583250.539130:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787583250.539244:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ec9f80 x1874416435913984/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787583266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583250.539256:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17896:1874416435913984:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787583250.539269:0:17896:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787583250.539301:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17896:1874416435914112:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787583250.539332:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583250.539358:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff909241761240 going to sleep for 11 seconds 00000100:00100000:1.0:1787583250.539465:0:19228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435914112 00000100:00100000:1.0:1787583250.539479:0:19228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435914112 00000100:00100000:1.0:1787583250.539515:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787583250.539529:0:19228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17896:x1874416435914112:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787583250.539555:0:19228:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1787583250.582045:0:18655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787583250.582061:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787583250.582250:0:19228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17896:x1874416435914112:12345-0@lo:5:osp-pre-0-1.0 Request processed in 42718us (42916us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787583250.582264:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787583250.582421:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ee4e00 x1874416435914112/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787583266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583250.582444:0:17896:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787583250.582451:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17896:1874416435914112:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787583250.582483:0:17896:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1787583250.582534:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17896:1874416435914240:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787583250.582571:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583250.582604:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff909241761240 going to sleep for 11 seconds 00000100:00100000:2.0:1787583250.582691:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435914240 00000100:00100000:2.0:1787583250.582698:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435914240 00000100:00100000:2.0:1787583250.582737:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787583250.582745:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17896:x1874416435914240:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787583250.582805:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17896:x1874416435914240:12345-0@lo:900:osp-pre-0-1.0 Request processed in 61us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583250.582811:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787583250.582901:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ee4e00 x1874416435914240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787583266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583250.582912:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17896:1874416435914240:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1787583251.292833:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583251.918114:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435914368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787583251.918182:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583251.918292:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435914368 00000100:00100000:3.0:1787583251.918299:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435914368 00000100:00100000:3.0:1787583251.918353:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787583251.918362:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435914368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787583251.918393:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787583251.918601:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435914368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 239us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583251.918610:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787583251.918699:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435914368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583251.919975:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787583251.919990:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435914496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583251.920041:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583251.920142:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435914496 00000100:00100000:0.0:1787583251.920149:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435914496 00000100:00100000:0.0:1787583251.920187:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787583251.920195:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435914496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787583251.920235:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787583251.920285:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435914496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583251.920291:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787583251.920335:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435914496:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787583252.302924:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583253.327427:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583254.351239:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787583254.393529:0:19473:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787583254.393533:0:19473:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787583254.393534:0:19473:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787583254.393648:0:19473:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90937fc57800 00000020:01000004:0.0:1787583254.393728:0:19473:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787583254.393743:0:19473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787583254.393755:0:19473:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff909343e199b8) 00000020:00000080:0.0:1787583254.393906:0:19473:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787583254.454492:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787583254.455402:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787583254.456150:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787583254.456490:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787583254.456953:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787583254.457309:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787583254.457551:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1787583254.462330:0:19473:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787583254.462557:0:19473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787583254.462572:0:19473:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787583254.462584:0:19473:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19a47956376b7564 00000020:01000004:3.0:1787583254.462591:0:19473:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787583254.462613:0:19473:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787583254.462616:0:19473:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787583254.462623:0:19473:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787583254.462653:0:19473:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787583254.462669:0:19473:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787583254.475476:0:19473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787583254.475513:0:19473:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787583254.475518:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787583254.475519:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787583254.475521:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787583254.475522:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787583254.475523:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787583254.475524:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787583254.475525:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787583254.475527:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787583254.475529:0:19473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787583254.475536:0:19473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787583254.475538:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787583254.475539:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787583254.475540:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787583254.475541:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787583254.475542:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787583254.475543:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787583254.475544:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787583254.475544:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787583254.475545:0:19473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787583254.475569:0:19473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787583254.475586:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435914624:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787583254.475650:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583254.475756:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff909341254180 going to sleep for 11 seconds 00000100:00100000:3.0:1787583254.477999:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435914624 00000100:00100000:3.0:1787583254.478026:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435914624 00000100:00100000:3.0:1787583254.478176:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787583254.478188:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+21:19473:x1874416435914624:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787583254.478247:0:17148:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787583254.478250:0:17148:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787583254.478254:0:17148:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787583254.478589:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+21:19473:x1874416435914624:12345-0@lo:253:mount.lustre.0 Request processed in 403us (2938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583254.478598:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787583254.478698:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435914624:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787583254.478711:0:19473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787583254.478714:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787583254.478716:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787583254.478717:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787583254.478718:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787583254.478719:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787583254.478720:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787583254.478722:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787583254.478724:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787583254.478725:0:19473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787583254.478754:0:19473:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90937fc57800 from lustre-OST0001 10000000:01000000:1.0:1787583254.478788:0:19473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787583254.478791:0:19473:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787583254.478799:0:19473:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff909373fd99b8 local copy 00010000:00010000:1.0:1787583254.478809:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583254.478942:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435914752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583254.478975:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.479396:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247690240 going to sleep for 11 seconds 00000100:00100000:0.0:1787583254.479503:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435914752 00000100:00100000:0.0:1787583254.479509:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435914752 00000100:00100000:1.0:1787583254.479588:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787583254.479596:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+21:19473:x1874416435914752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583254.479677:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+21:19473:x1874416435914752:12345-0@lo:501:mount.lustre.0 Request processed in 81us (700us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787583254.479692:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787583254.479942:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435914752:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787583254.479958:0:19473:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787583254.479994:0:19473:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787583254.480001:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.480011:0:19473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344ded400/0x19a47956376b727e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7285 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583254.480040:0:19473:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90937fc57800 10000000:01000000:0.0:1787583254.480045:0:19473:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787583254.480061:0:19473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787583254.480065:0:19473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787583254.480069:0:19473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787583254.480072:0:19473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787583254.480095:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713e800/0x19a47956376b756b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.480109:0:19473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924713e800/0x19a47956376b756b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.480119:0:19473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924713e800/0x19a47956376b756b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583254.480134:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435914880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787583254.480164:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583254.480182:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff90934512dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787583254.480237:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435914880 00000100:00100000:1.0:1787583254.480241:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435914880 00000100:00100000:1.0:1787583254.480261:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787583254.480267:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+21:19473:x1874416435914880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787583254.480274:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583254.480286:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909247c52c00/0x19a47956376b7572 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b756b expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.480305:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909247c52c00/0x19a47956376b7572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b756b expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.480314:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909247c52c00/0x19a47956376b7572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b756b expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.480322:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909247c52c00, rc 0) 00000100:00100000:1.0:1787583254.480357:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+22:19473:x1874416435914880:12345-0@lo:101:mount.lustre.0 Request processed in 90us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.480363:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787583254.480547:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435914880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583254.480558:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924713e800/0x19a47956376b756b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7572 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.480567:0:19473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924713e800/0x19a47956376b756b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7572 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787583254.481883:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787583254.483968:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787583254.489527:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787583254.489592:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787583254.489610:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787583254.489625:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787583254.489639:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787583254.489652:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787583254.489675:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787583254.489681:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787583254.490176:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787583254.490308:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583254.490400:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be600 going to sleep for 11 seconds 00000100:00100000:1.0:1787583254.490640:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435915008 00000100:00100000:1.0:1787583254.490648:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435915008 00000100:00100000:2.0:1787583254.490947:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787583254.490960:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+22:19473:x1874416435915008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583254.491309:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+22:19473:x1874416435915008:12345-0@lo:501:mount.lustre.0 Request processed in 351us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583254.491318:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787583254.491479:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787583254.491523:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787583254.491570:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583254.491602:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be600 going to sleep for 11 seconds 00000100:00100000:3.0:1787583254.492598:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435915136 00000100:00100000:3.0:1787583254.492608:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435915136 00000100:00100000:3.0:1787583254.492768:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787583254.492777:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+22:19473:x1874416435915136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787583254.493652:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+22:19473:x1874416435915136:12345-0@lo:503:mount.lustre.0 Request processed in 873us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583254.493671:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787583254.494919:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915136:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787583254.495386:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787583254.495498:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787583254.495565:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583254.495597:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff90937cd26840 going to sleep for 11 seconds 00000100:00100000:3.0:1787583254.495926:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435915264 00000100:00100000:3.0:1787583254.495933:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435915264 00000100:00100000:3.0:1787583254.495967:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787583254.495976:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+22:19473:x1874416435915264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583254.496688:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+22:19473:x1874416435915264:12345-0@lo:502:mount.lustre.0 Request processed in 710us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583254.496699:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787583254.497933:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787583254.498433:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787583254.498509:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787583254.498524:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787583254.498538:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787583254.498551:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787583254.498564:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787583254.498576:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787583254.498586:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787583254.498598:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787583254.498633:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583254.498995:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583254.499145:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936a11d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787583254.499200:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435915392 00000100:00100000:1.0:1787583254.499207:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435915392 00000100:00100000:1.0:1787583254.499354:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787583254.499363:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+22:19473:x1874416435915392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787583254.499495:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+22:19473:x1874416435915392:12345-0@lo:502:mount.lustre.0 Request processed in 131us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.499502:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787583254.499589:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787583254.499639:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787583254.499649:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1787583254.500303:0:19477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787583254.500311:0:19477:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787583254.500317:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787583254.500320:0:19477:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787583254.500325:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787583254.500338:0:19477:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90936db23370) 00000020:00000080:2.0:1787583254.500359:0:19477:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787583254.500364:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787583254.500457:0:19477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90937fc57800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787583254.500470:0:19477:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787583254.500477:0:19477:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19a47956376b7580 00010000:00010000:1.0:1787583254.505564:0:19477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787583254.506478:0:19477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1787583254.508289:0:19477:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787583254.509739:0:19477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787583254.509751:0:19477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787583254.509758:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583254.509761:0:19477:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787583254.509764:0:19477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787583254.509768:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583254.509769:0:19477:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787583254.509773:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787583254.509775:0:19477:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787583254.509777:0:19477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787583254.509779:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583254.509780:0:19477:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787583254.509782:0:19477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787583254.509784:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583254.509786:0:19477:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787583254.509788:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787583254.509812:0:19477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787583254.509815:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787583254.509817:0:19477:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787583254.509819:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787583254.510096:0:19473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787583254.510123:0:19473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787583254.510145:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713e800/0x19a47956376b756b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7572 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.510157:0:19473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924713e800/0x19a47956376b756b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7572 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583254.510166:0:19473:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90937fc57800 from 1 10000000:01000000:0.0:1787583254.510169:0:19473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787583254.510204:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.510212:0:19473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.510234:0:19473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583254.510256:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787583254.510321:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583254.510355:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435915520 00000100:00100000:0.0:1787583254.510360:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435915520 00000100:00100000:0.0:1787583254.510396:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787583254.510404:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+22:19473:x1874416435915520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583254.510417:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583254.510429:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924713fa00/0x19a47956376b758e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b7587 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.510462:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924713fa00/0x19a47956376b758e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b7587 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.510473:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924713fa00/0x19a47956376b758e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7587 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.510481:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713fa00, rc 0) 00000100:00100000:0.0:1787583254.510514:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:19473:x1874416435915520:12345-0@lo:101:mount.lustre.0 Request processed in 110us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583254.510520:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787583254.510557:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be900 going to sleep for 11 seconds 00000100:00100000:0.0:1787583254.510576:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915520:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787583254.510592:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b758e expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.510600:0:19473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b758e expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787583254.512017:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787583254.512492:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787583254.512789:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787583254.512819:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787583254.512838:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787583254.512957:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787583254.513028:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787583254.513155:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583254.513239:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be540 going to sleep for 11 seconds 00000100:00100000:1.0:1787583254.517839:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435915648 00000100:00100000:1.0:1787583254.517918:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435915648 00000100:00100000:1.0:1787583254.518012:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787583254.518023:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+23:19473:x1874416435915648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583254.518204:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+23:19473:x1874416435915648:12345-0@lo:501:mount.lustre.0 Request processed in 182us (5049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.518212:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787583254.519814:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787583254.519886:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787583254.519945:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583254.522981:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787583254.523086:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435915776 00000100:00100000:0.0:1787583254.523094:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435915776 00000100:00100000:0.0:1787583254.523137:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787583254.523145:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:19473:x1874416435915776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787583254.523416:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:19473:x1874416435915776:12345-0@lo:503:mount.lustre.0 Request processed in 270us (3469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583254.523424:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787583254.524030:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915776:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787583254.524626:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787583254.524726:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583254.524931:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583254.524967:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787583254.525033:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435915904 00000100:00100000:1.0:1787583254.525046:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435915904 00000100:00100000:1.0:1787583254.525095:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787583254.525104:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:19473:x1874416435915904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787583254.525203:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:19473:x1874416435915904:12345-0@lo:502:mount.lustre.0 Request processed in 99us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.525211:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787583254.525389:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435915904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787583254.525565:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787583254.525590:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787583254.525604:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787583254.525615:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787583254.525626:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787583254.525638:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787583254.525682:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787583254.525699:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787583254.525712:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787583254.525723:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787583254.525891:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787583254.525917:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787583254.525953:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583254.525976:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f1f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1787583254.526039:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435916032 00000100:00100000:2.0:1787583254.526044:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435916032 00000100:00100000:2.0:1787583254.526088:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787583254.526096:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+23:19473:x1874416435916032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787583254.526174:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+23:19473:x1874416435916032:12345-0@lo:502:mount.lustre.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583254.526180:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787583254.526351:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787583254.526386:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787583254.526393:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787583254.527170:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583254.527180:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583254.527182:0:19481:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787583254.527188:0:19481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90937fc57800 00000020:00000080:3.0:1787583254.527191:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787583254.527198:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583254.527200:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583254.527201:0:19481:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787583254.527204:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583254.527206:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583254.527207:0:19481:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787583254.527210:0:19481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90937fc57800 00000020:00000080:3.0:1787583254.527212:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787583254.527337:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583254.527341:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583254.527342:0:19481:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787583254.527344:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583254.527347:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583254.527348:0:19481:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787583254.527351:0:19481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90937fc57800 00000020:00000080:3.0:1787583254.527362:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787583254.527378:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583254.527380:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583254.527382:0:19481:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787583254.527384:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787583254.527386:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583254.527387:0:19481:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787583254.527390:0:19481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90937fc57800 00000020:00000080:3.0:1787583254.527392:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787583254.527412:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787583254.527415:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787583254.527417:0:19481:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787583254.527419:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1787583254.535186:0:19473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787583254.535306:0:19473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787583254.535613:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b758e expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.535625:0:19473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b758e expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583254.535716:0:19473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787583254.535719:0:19473:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90937fc57800 10000000:01000000:1.0:1787583254.535722:0:19473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90937fc57800 10000000:01000000:1.0:1787583254.535726:0:19473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787583254.535873:0:19473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90937fc57800 from 1 10000000:01000000:1.0:1787583254.535876:0:19473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787583254.535912:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c52800/0x19a47956376b7595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.535921:0:19473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909247c52800/0x19a47956376b7595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.535931:0:19473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909247c52800/0x19a47956376b7595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583254.535953:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787583254.536030:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.536084:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff90938205ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787583254.537959:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435916160 00000100:00100000:3.0:1787583254.537973:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435916160 00000100:00100000:3.0:1787583254.538031:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787583254.538042:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+23:19473:x1874416435916160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787583254.538067:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583254.538083:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909248496800/0x19a47956376b759c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b7595 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583254.538109:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909248496800/0x19a47956376b759c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b7595 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583254.538120:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909248496800/0x19a47956376b759c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7595 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583254.538129:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248496800, rc 0) 00000100:00100000:3.0:1787583254.538192:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435916160:12345-0@lo:101:mount.lustre.0 Request processed in 152us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583254.538199:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787583254.538380:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787583254.538397:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909247c52800/0x19a47956376b7595 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b759c expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.538408:0:19473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909247c52800/0x19a47956376b7595 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b759c expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787583254.539583:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1787583254.545209:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787583254.545466:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787583254.545493:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787583254.545507:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787583254.545521:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787583254.545534:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787583254.545547:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787583254.545561:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787583254.545574:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787583254.545588:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787583254.545601:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787583254.545614:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787583254.545627:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787583254.545641:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787583254.545834:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787583254.545877:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787583254.545892:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787583254.545919:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787583254.545935:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787583254.545946:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787583254.545958:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787583254.545984:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787583254.545998:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787583254.546010:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787583254.546023:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787583254.546037:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787583254.546050:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787583254.546062:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787583254.546076:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787583254.546089:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787583254.546102:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787583254.546115:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787583254.546128:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787583254.546157:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787583254.546173:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787583254.546184:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787583254.546196:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787583254.546209:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787583254.546235:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787583254.546249:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1787583254.546260:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1787583254.546271:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1787583254.546284:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1787583254.546296:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1787583254.546308:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1787583254.546319:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1787583254.546331:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1787583254.546352:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1787583254.546357:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1787583254.546463:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583254.546524:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.546574:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435916288 00000100:00100000:1.0:1787583254.546581:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435916288 00000100:00100000:1.0:1787583254.546628:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787583254.546636:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435916288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583254.547821:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435916288:12345-0@lo:501:mount.lustre.0 Request processed in 1181us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.547831:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787583254.547889:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465b59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583254.547910:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787583254.547946:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787583254.547987:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.548015:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435916416 00000100:00100000:1.0:1787583254.548020:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435916416 00000100:00100000:1.0:1787583254.548046:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787583254.548187:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435916416:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787583254.548321:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435916416:12345-0@lo:503:mount.lustre.0 Request processed in 137us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.548328:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787583254.548371:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465b59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787583254.548384:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787583254.550038:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787583254.550144:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787583254.550206:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.550375:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465b59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583254.550430:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435916544 00000100:00100000:2.0:1787583254.550437:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435916544 00000100:00100000:2.0:1787583254.550490:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787583254.550500:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435916544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787583254.550598:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435916544:12345-0@lo:502:mount.lustre.0 Request processed in 99us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583254.550606:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787583254.550703:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787583254.551037:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787583254.551174:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787583254.551202:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787583254.551287:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787583254.551309:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787583254.551321:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787583254.551332:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787583254.551343:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787583254.551354:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787583254.551365:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787583254.551376:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787583254.551388:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787583254.551400:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787583254.551413:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787583254.551429:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787583254.551469:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787583254.551486:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787583254.551498:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787583254.551516:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787583254.551530:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787583254.551541:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787583254.551554:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787583254.551568:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787583254.551581:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787583254.551594:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1787583254.551608:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1787583254.551623:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1787583254.551634:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1787583254.551646:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1787583254.552343:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1787583254.552373:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1787583254.552401:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1787583254.552417:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1787583254.552428:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1787583254.552467:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1787583254.552493:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1787583254.552508:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1787583254.552523:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1787583254.552535:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1787583254.552545:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1787583254.552557:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1787583254.552569:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1787583254.552582:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1787583254.552595:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1787583254.552609:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1787583254.552621:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1787583254.552633:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1787583254.554940:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1787583254.555031:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787583254.556035:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.556328:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435916672 00000100:00100000:1.0:1787583254.556335:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435916672 00000100:00100000:1.0:1787583254.556433:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787583254.556454:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435916672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787583254.556569:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435916672:12345-0@lo:502:mount.lustre.0 Request processed in 127us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.556577:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787583254.565942:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465b59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787583254.565987:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787583254.566273:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787583254.566303:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787583254.566341:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787583254.566531:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583254.566570:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff90937cd26c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787583254.568831:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435916800 00000100:00100000:1.0:1787583254.568994:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435916800 00000100:00100000:1.0:1787583254.569081:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787583254.569092:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435916800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787583254.569251:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435916800:12345-0@lo:502:mount.lustre.0 Request processed in 155us (2714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.569259:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787583254.571021:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435916800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787583254.571123:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787583254.571137:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787583254.572675:0:19486:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787583254.572691:0:19486:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff909373fd8000) 00000020:00000080:1.0:1787583254.572715:0:19486:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787583254.572830:0:19486:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90937fc57800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787583254.572834:0:19486:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90937fc57800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787583254.572837:0:19486:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90937fc57800 3 00010000:00080000:1.0:1787583254.572883:0:19486:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9092414f7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1787583254.574555:0:19486:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1787583254.574748:0:19486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787583254.574787:0:19486:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787583254.574802:0:19486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x19a47956376b75aa 00000100:00080000:1.0:1787583254.574813:0:19486:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787583254.574818:0:19486:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9092414f7000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1787583254.574874:0:19486:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247ecaa00 x1874416435916928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787583254.574920:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874416435916928:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787583254.574983:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.575045:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435916928 00000100:00100000:1.0:1787583254.575052:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435916928 00000100:00100000:1.0:1787583254.575082:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787583254.575090:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874416435916928:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787583254.575114:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:1.0:1787583254.575143:0:17154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x19a47956376b75b1 00000004:00100000:1.0:1787583254.575158:0:17154:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787583254.575201:0:17154:0:(import.c:65:import_set_state_nolock()) ffff909246521000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787583254.575249:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874416435916928:12345-0@lo:38:llog_process_th.0 Request processed in 159us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.575267:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787583254.575305:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ecaa00 x1874416435916928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787583264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583254.575315:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787583254.575321:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787583254.575327:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787583254.575330:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787583254.575332:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9092414f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787583254.575337:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874416435916928:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787583254.575353:0:19486:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787583254.575396:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787583254.575400:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787583254.575403:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787583254.575406:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787583254.575435:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1787583254.579805:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435917184:0@lo:400:kworker.0 00000100:00100000:0.0:1787583254.579895:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583254.579939:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787583254.579947:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435917056:0@lo:400:kworker.0 00000100:00100000:0.0:1787583254.579973:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583254.580014:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435917184 00000100:00100000:0.0:1787583254.580022:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435917184 00000100:00100000:0.0:1787583254.580080:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787583254.580090:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435917184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583254.580145:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435917184:12345-0@lo:400:kworker.0 Request processed in 56us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583254.580153:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787583254.580207:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ecb100 x1874416435917184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583254.580221:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435917184:0@lo:400:kworker.0 00000100:00100000:3.0:1787583254.582454:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435917056 00000100:00100000:3.0:1787583254.582467:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435917056 00000100:00100000:3.0:1787583254.582519:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787583254.582528:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435917056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583254.582622:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435917056:12345-0@lo:400:kworker.0 Request processed in 95us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583254.582629:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787583254.583409:0:15041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787583254.583416:0:15041:0:(import.c:65:import_set_state_nolock()) ffff909247c41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787583254.583424:0:15041:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 557 00000100:00080000:1.0:1787583254.583428:0:15041:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787583254.583434:0:15041:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff909247c41800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1787583254.584310:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435917056:0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.584984:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435917312:0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.585048:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.585107:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787583254.585114:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435917440:0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.585140:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.585174:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435917312 00000100:00100000:1.0:1787583254.585180:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435917312 00000100:00100000:1.0:1787583254.585235:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787583254.585245:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435917312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.585300:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435917312:12345-0@lo:400:kworker.0 Request processed in 56us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.585307:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787583254.585330:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435917440 00000100:00100000:1.0:1787583254.585334:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435917440 00000100:00100000:1.0:1787583254.585367:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787583254.585373:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435917440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.585416:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435917440:12345-0@lo:400:kworker.0 Request processed in 42us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.585422:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787583254.585585:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ecb800 x1874416435917440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583254.585597:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435917440:0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.585608:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435917312:0@lo:400:kworker.0 00000100:00080000:1.0:1787583254.585629:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583254.585674:0:15041:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247ec9500 x1874416435917568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787583254.585703:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435917568:0@lo:8:kworker.0 00000100:00100000:1.0:1787583254.585935:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.585978:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435917568 00000100:00100000:1.0:1787583254.585983:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435917568 00000100:00100000:1.0:1787583254.586011:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787583254.586016:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874416435917568:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787583254.586131:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874416435917568:12345-0@lo:8:kworker.0 Request processed in 113us (401us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787583254.586137:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787583254.586160:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787583254.586167:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909247c41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787583254.586171:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787583254.586175:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435917568:0@lo:8:kworker.0 00000100:00100000:1.0:1787583254.586213:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435917696:0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.586240:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.586272:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435917696 00000100:00100000:1.0:1787583254.586276:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435917696 00000100:00100000:1.0:1787583254.586301:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787583254.586307:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435917696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.586343:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435917696:12345-0@lo:400:kworker.0 Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.586350:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787583254.586377:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ec9500 x1874416435917696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583254.586387:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435917696:0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.587351:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435917824:0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.587390:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.587502:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435917824 00000100:00100000:1.0:1787583254.587513:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435917824 00000100:00100000:1.0:1787583254.587555:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787583254.587564:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435917824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.587640:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435917824:12345-0@lo:400:kworker.0 Request processed in 43us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.587647:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787583254.588530:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787583254.588568:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247ec9500 x1874416435917824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583254.588583:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435917824:0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.588632:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435917952:0@lo:400:kworker.0 00000100:00100000:1.0:1787583254.588966:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583254.589489:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435917952 00000100:00100000:2.0:1787583254.589497:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435917952 00000100:00100000:2.0:1787583254.589551:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787583254.589559:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435917952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583254.589607:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435917952:12345-0@lo:400:kworker.0 Request processed in 49us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583254.589614:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787583254.590140:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787583254.590171:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909348841500 x1874416435917952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583254.590184:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435917952:0@lo:400:kworker.0 00000020:01000004:2.0:1787583254.594986:0:19486:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787583254.595003:0:19486:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90936db20000) 00000020:00000080:2.0:1787583254.595026:0:19486:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787583254.595551:0:19486:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90937fc57800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787583254.595556:0:19486:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90937fc57800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787583254.595559:0:19486:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90937fc57800 3 00010000:00080000:2.0:1787583254.595590:0:19486:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9092414f5800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1787583254.599359:0:19486:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787583254.599796:0:19486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787583254.599865:0:19486:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787583254.599884:0:19486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x19a47956376b75bf 00000100:00080000:2.0:1787583254.599894:0:19486:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787583254.599899:0:19486:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9092414f5800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583254.599930:0:19486:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f82d80 x1874416435918080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787583254.599953:0:19486:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787583254.602488:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874416435918080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787583254.602565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.602623:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435918080 00000100:00100000:1.0:1787583254.602630:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435918080 00000040:00080000:2.0:1787583254.602925:0:19486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1787583254.603012:0:19473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787583254.603039:0:19473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787583254.603071:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c52800/0x19a47956376b7595 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b759c expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583254.603082:0:19473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909247c52800/0x19a47956376b7595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b759c expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787583254.603127:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787583254.603129:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787583254.603131:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787583254.603132:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787583254.603133:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787583254.603134:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787583254.603136:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787583254.603138:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787583254.603139:0:19473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787583254.603143:0:19473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787583254.603145:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787583254.603146:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787583254.603148:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787583254.603149:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787583254.603150:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787583254.603151:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787583254.603152:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787583254.603153:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787583254.603154:0:19473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787583254.603178:0:19473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787583254.603191:0:19473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435918208:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787583254.603228:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583254.603244:0:19473:0:(client.c:2715:ptlrpc_set_wait()) set ffff909346beaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787583254.603399:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787583254.603416:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874416435918080:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787583254.603450:0:17153:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:1.0:1787583254.603482:0:17153:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x19a47956376b75c6 00000004:00100000:1.0:1787583254.603495:0:17153:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787583254.603533:0:17153:0:(import.c:65:import_set_state_nolock()) ffff909246525000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787583254.603585:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874416435918080:12345-0@lo:38:llog_process_th.0 Request processed in 168us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.603592:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787583254.603615:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435918208 00000100:00100000:1.0:1787583254.603619:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435918208 00000100:00100000:1.0:1787583254.603647:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787583254.603725:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435918208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787583254.603809:0:17145:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787583254.603824:0:17145:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1787583254.603957:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff909247f82d80 x1874416435918080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787583264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583254.603969:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787583254.603976:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787583254.603982:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787583254.603986:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787583254.603989:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9092414f5800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787583254.603994:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874416435918080:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787583254.604018:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787583254.604022:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787583254.604025:0:15041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787583254.604028:0:15041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:3.0:1787583254.607549:0:17145:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787583254.607568:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787583254.607664:0:17169:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787583254.607669:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787583254.607690:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.607717:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924713fc00/0x19a47956376b7541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b753a expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.607730:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909247c52600/0x19a47956376b754f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7548 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.607738:0:17169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.607772:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909247c52600/0x19a47956376b754f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b7548 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.607786:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff909247c52600/0x19a47956376b754f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b7548 expref: 24 pid: 17147 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583254.607800:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435918336:0@lo:104: 00000100:00100000:1.0:1787583254.607894:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787583254.607943:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924713fc00/0x19a47956376b7541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b753a expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.607952:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90924713fc00/0x19a47956376b7541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b753a expref: 24 pid: 17145 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583254.607959:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435918464:0@lo:104: 00000100:00100000:1.0:1787583254.607981:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.608000:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465b5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787583254.608160:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435918336 00000100:00100000:0.0:1787583254.608168:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435918336 00000100:00100000:0.0:1787583254.608200:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435918464 00000100:00100000:0.0:1787583254.608203:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435918464 00000100:00100000:0.0:1787583254.608217:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787583254.608226:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea761437-c095-48a5-91f7-0c431111ca6a+4:17169:x1874416435918336:12345-0@lo:104: 00010000:00010000:0.0:1787583254.608238:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b754f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.608296:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787583254.608302:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea761437-c095-48a5-91f7-0c431111ca6a+4:17169:x1874416435918336:12345-0@lo:104: Request processed in 77us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583254.608309:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787583254.608325:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787583254.608332:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea761437-c095-48a5-91f7-0c431111ca6a+3:17169:x1874416435918464:12345-0@lo:104: 00010000:00010000:0.0:1787583254.608340:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b7541 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.608370:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787583254.608376:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea761437-c095-48a5-91f7-0c431111ca6a+3:17169:x1874416435918464:12345-0@lo:104: Request processed in 45us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583254.608381:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787583254.608397:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787583254.608402:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b754f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.608421:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dece00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583254.608425:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b754f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.608433:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b754f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583254.608450:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b754f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583254.608456:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787583254.608482:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b754f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.608488:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787583254.608503:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b754f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.608509:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344dece00/0x19a47956376b7548 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b754f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.608524:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583254.608528:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b7541 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.608533:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344deca00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1787583254.608536:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b7541 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.608552:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b7541 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787583254.608558:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b7541 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787583254.608563:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787583254.608575:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7541 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.608581:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787583254.608592:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7541 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.608599:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909344deca00/0x19a47956376b753a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b7541 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583254.608611:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583254.608613:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583254.608615:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583254.608683:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583254.609027:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+24:19473:x1874416435918208:12345-0@lo:253:mount.lustre.0 Request processed in 5371us (5796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583254.609036:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787583254.609204:0:19473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea761437-c095-48a5-91f7-0c431111ca6a:19473:1874416435918208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787583254.609216:0:19473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787583254.609219:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787583254.609220:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787583254.609221:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787583254.609222:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787583254.609224:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787583254.609225:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787583254.609226:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787583254.609228:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787583254.609230:0:19473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787583254.609248:0:19473:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787583254.610226:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea761437-c095-48a5-91f7-0c431111ca6a:3654:1874416435918592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583254.610270:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.610337:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435918720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583254.610359:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583254.610395:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435918592 00000100:00100000:1.0:1787583254.610400:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435918592 00010000:00010000:1.0:1787583254.610425:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909247c52600/0x19a47956376b754f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b7548 expref: 24 pid: 17147 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583254.610459:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435918720 00000100:00100000:1.0:1787583254.610462:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435918720 00010000:00010000:1.0:1787583254.610474:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924713fc00/0x19a47956376b7541 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b753a expref: 25 pid: 17145 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583254.610487:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787583254.610495:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea761437-c095-48a5-91f7-0c431111ca6a+25:3654:x1874416435918592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583254.610508:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583254.610512:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909247c52600/0x19a47956376b754f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b7548 expref: 25 pid: 17147 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610523:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909247c52600/0x19a47956376b754f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b7548 expref: 25 pid: 17147 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610540:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583254.610569:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea761437-c095-48a5-91f7-0c431111ca6a+25:3654:x1874416435918592:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.610575:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787583254.610590:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787583254.610596:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea761437-c095-48a5-91f7-0c431111ca6a+24:3655:x1874416435918720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583254.610603:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583254.610608:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924713fc00/0x19a47956376b7541 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b753a expref: 24 pid: 17145 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610622:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924713fc00/0x19a47956376b7541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b753a expref: 24 pid: 17145 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610634:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610642:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787583254.610665:0:17139:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013455151s 00010000:00010000:1.0:1787583254.610669:0:17139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610677:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610684:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610690:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610696:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53600 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787583254.610700:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610708:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610716:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610730:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583254.610757:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea761437-c095-48a5-91f7-0c431111ca6a+24:3655:x1874416435918720:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583254.610763:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787583254.610793:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435918720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583254.610813:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea761437-c095-48a5-91f7-0c431111ca6a:3654:1874416435918592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583254.610834:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909247c52600/0x19a47956376b754f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b7548 expref: 23 pid: 17147 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583254.610862:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435918336:0@lo:104: 00010000:00010000:1.0:1787583254.610873:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713fc00/0x19a47956376b7541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b753a expref: 22 pid: 17145 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583254.610880:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1874416435918464:0@lo:104: 00010000:00010000:1.0:1787583254.610891:0:17169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610900:0:17169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610906:0:17169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583254.610912:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909247c53600/0x19a47956376b75cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787583254.631544:0:19473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787583254.635414:0:19473:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787583254.635425:0:19473:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787583254.635469:0:19473:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787583254.635508:0:19473:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787583254.635527:0:19473:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787583254.635552:0:19473:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787583254.636455:0:19473:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787583254.636679:0:19473:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1787583254.803145:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787583255.374954:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787583255.390536:0:19539:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787583255.392329:0:19539:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787583256.016976:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435918848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583256.017044:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583256.017171:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435918848 00000100:00100000:0.0:1787583256.017178:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435918848 00000100:00100000:0.0:1787583256.017252:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787583256.017262:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435918848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583256.017289:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787583256.017337:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435918848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583256.017344:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787583256.017381:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fce8000 x1874416435918848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583256.017397:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435918848:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787583256.017599:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1787583256.335483:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787583256.335490:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90935822f800 from 10 10000000:01000000:1.0:1787583256.335496:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787583256.335539:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c52000/0x19a47956376b75d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583256.335552:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909247c52000/0x19a47956376b75d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583256.335564:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909247c52000/0x19a47956376b75d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583256.335591:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435918976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787583256.335659:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583256.335701:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465b5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583256.335761:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435918976 00000100:00100000:3.0:1787583256.335769:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435918976 00000100:00100000:3.0:1787583256.335822:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787583256.335839:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+22:17151:x1874416435918976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787583256.335870:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583256.335883:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909248497600/0x19a47956376b75db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b75d4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583256.335907:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909248497600/0x19a47956376b75db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b75d4 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583256.335918:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909248497600/0x19a47956376b75db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b75d4 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583256.335927:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248497600, rc 0) 00000100:00100000:3.0:1787583256.335967:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+23:17151:x1874416435918976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583256.335974:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787583256.336085:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435918976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583256.336100:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909247c52000/0x19a47956376b75d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b75db expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583256.336110:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909247c52000/0x19a47956376b75d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b75db expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583256.336157:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435919104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787583256.336188:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583256.336218:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465b5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583256.336278:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435919104 00000100:00100000:3.0:1787583256.336283:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435919104 00000100:00100000:3.0:1787583256.336317:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787583256.336324:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:17151:x1874416435919104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787583256.336337:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787583256.336352:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787583256.336354:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787583256.336425:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:17151:x1874416435919104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583256.336447:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787583256.337272:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435919104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787583256.337356:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787583256.337364:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c52000/0x19a47956376b75d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b75db expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583256.337378:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909247c52000/0x19a47956376b75d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b75db expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787583256.337387:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787583256.337389:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff909248438000 from 10 10000000:01000000:1.0:1787583256.337392:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787583256.337415:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c53000/0x19a47956376b75e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583256.337422:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909247c53000/0x19a47956376b75e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583256.337440:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909247c53000/0x19a47956376b75e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583256.337456:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435919232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787583256.337493:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583256.337530:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465b5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583256.337591:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435919232 00000100:00100000:3.0:1787583256.337606:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435919232 00000100:00100000:3.0:1787583256.337645:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787583256.337653:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+23:17151:x1874416435919232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787583256.337667:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583256.337677:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909248496c00/0x19a47956376b75e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b75e2 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583256.337695:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909248496c00/0x19a47956376b75e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b75e2 expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583256.337703:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909248496c00/0x19a47956376b75e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b75e2 expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583256.337723:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909248496c00, rc 0) 00000100:00100000:3.0:1787583256.337763:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+24:17151:x1874416435919232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583256.337770:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787583256.338026:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435919232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583256.338038:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909247c53000/0x19a47956376b75e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b75e9 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583256.338046:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909247c53000/0x19a47956376b75e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b75e9 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583256.338086:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435919360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787583256.338114:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583256.338147:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465b5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583256.338192:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435919360 00000100:00100000:3.0:1787583256.338197:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435919360 00000100:00100000:3.0:1787583256.338226:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787583256.338234:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+24:17151:x1874416435919360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787583256.338248:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787583256.338263:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787583256.338266:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787583256.338361:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+24:17151:x1874416435919360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583256.338369:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787583256.338448:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435919360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787583256.338500:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787583256.338506:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909247c53000/0x19a47956376b75e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b75e9 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583256.338514:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909247c53000/0x19a47956376b75e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b75e9 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583256.398008:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583257.039013:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435919488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787583257.039083:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583257.039128:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583257.039133:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435919616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787583257.039150:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.039370:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435919488 00000100:00100000:2.0:1787583257.039379:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435919488 00000100:00100000:2.0:1787583257.039439:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435919616 00000100:00100000:2.0:1787583257.039442:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435919616 00000100:00100000:2.0:1787583257.039459:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787583257.039469:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435919488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787583257.039500:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787583257.039549:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435919488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.039556:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787583257.039571:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787583257.039577:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435919616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787583257.039592:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787583257.039617:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435919616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.039634:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787583257.039676:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435919616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787583257.039688:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435919488:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787583257.423816:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583257.681484:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583237/real 1787583237] req@ffff909348843480 x1874416435906304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583257 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583257.681518:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff909348843480 x1874416435906304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583257 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583257.681536:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787583237/real 1787583237] req@ffff909348840000 x1874416435906432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583257 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583257.681550:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff909348840000 x1874416435906432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787583257 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787583257.681568:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909245b04000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787583257.681588:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787583257.681593:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435906304:0@lo:8:kworker.0 00000100:00080000:3.0:1787583257.681599:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909246692000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787583257.681604:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787583257.681607:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435906432:0@lo:8:kworker.0 00000100:00080000:2.0:1787583257.681807:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787583257.681812:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787583257.681814:0:36:0:(import.c:65:import_set_state_nolock()) ffff909245b04000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787583257.681819:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 544 00000100:00080000:2.0:1787583257.681823:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787583257.681830:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff909245b04000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583257.681879:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f80e00 x1874416435919872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787583257.681891:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787583257.681894:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787583257.681896:0:36:0:(import.c:65:import_set_state_nolock()) ffff909246692000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787583257.681899:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 544 00000100:00080000:2.0:1787583257.681902:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787583257.681905:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff909246692000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583257.681917:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff909247f81c00 x1874416435920000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787583257.681951:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787583257.681955:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787583257.681956:0:36:0:(import.c:65:import_set_state_nolock()) ffff909247c41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787583257.681961:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff909247c41800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1787583257.681981:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90937fc8b100 x1874416435920384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787583257.682034:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435920128:0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682094:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.682126:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435920768:0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682148:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.682168:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787583257.682174:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435919744:0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682199:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.682226:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435920640:0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682251:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.682277:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435920256:0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682303:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.682321:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435920896:0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682344:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.682362:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787583257.682368:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435920512:0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682404:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.682431:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435921024:0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682455:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.682482:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435920128 00000100:00100000:2.0:1787583257.682488:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435920128 00000100:00100000:2.0:1787583257.682522:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435920768 00000100:00100000:2.0:1787583257.682525:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435920768 00000100:00100000:2.0:1787583257.682552:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435920640 00000100:00100000:2.0:1787583257.682555:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435920640 00000100:00100000:2.0:1787583257.682580:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435920896 00000100:00100000:2.0:1787583257.682582:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435920896 00000100:00100000:2.0:1787583257.682594:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435920512 00000100:00100000:2.0:1787583257.682596:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435920512 00000100:00100000:2.0:1787583257.682606:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435921024 00000100:00100000:2.0:1787583257.682609:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435921024 00000100:00100000:2.0:1787583257.682623:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787583257.682631:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435920128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682680:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435920128:12345-0@lo:400:kworker.0 Request processed in 49us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.682688:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787583257.682704:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787583257.682711:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435920768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682738:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435920768:12345-0@lo:400:kworker.0 Request processed in 28us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.682744:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787583257.682756:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787583257.682761:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435920640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682787:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435920640:12345-0@lo:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.682793:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787583257.682803:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787583257.682810:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435920896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682839:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435920896:12345-0@lo:400:kworker.0 Request processed in 30us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.682867:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787583257.682879:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787583257.682892:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435920512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682922:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435920512:12345-0@lo:400:kworker.0 Request processed in 31us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.682928:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787583257.682941:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787583257.682947:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435921024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.682971:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435921024:12345-0@lo:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.682977:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787583257.682999:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435919744 00000100:00100000:2.0:1787583257.683003:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435919744 00000100:00100000:2.0:1787583257.683026:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787583257.683032:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+24:3656:x1874416435919744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.683061:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+24:3656:x1874416435919744:12345-0@lo:400:kworker.0 Request processed in 29us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.683066:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787583257.683094:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435920256 00000100:00100000:2.0:1787583257.683098:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435920256 00000100:00100000:2.0:1787583257.683123:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787583257.683130:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435920256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.683158:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435920256:12345-0@lo:400:kworker.0 Request processed in 29us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.683164:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787583257.683183:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583257.683186:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787583257.683212:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc88700 x1874416435920512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583257.683239:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435920512:0@lo:400:kworker.0 00010000:00080000:2.0:1787583257.683253:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc8aa00 x1874416435921024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583257.683262:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435921024:0@lo:400:kworker.0 00010000:00080000:2.0:1787583257.683270:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247f82d80 x1874416435920256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787583273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583257.683278:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435920256:0@lo:400:kworker.0 00010000:00080000:2.0:1787583257.683287:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc88380 x1874416435920896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583257.683294:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435920896:0@lo:400:kworker.0 00000100:00100000:2.0:1787583257.683324:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435919744:0@lo:400:kworker.0 00010000:00080000:2.0:1787583257.683333:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc8b480 x1874416435920640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583257.683341:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435920640:0@lo:400:kworker.0 00010000:00080000:2.0:1787583257.683350:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247f80a80 x1874416435920128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583257.683357:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435920128:0@lo:400:kworker.0 00010000:00080000:2.0:1787583257.683366:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc88a80 x1874416435920768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583257.683373:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435920768:0@lo:400:kworker.0 00000100:00100000:3.0:1787583257.683975:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435919872:0@lo:8:kworker.0 00000100:00100000:3.0:1787583257.684014:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583257.684052:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435920000:0@lo:8:kworker.0 00000100:00100000:3.0:1787583257.684074:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583257.684090:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435920384:0@lo:8:kworker.0 00000100:00100000:3.0:1787583257.684108:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583257.684132:0:19228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435919872 00000100:00100000:3.0:1787583257.684137:0:19228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435919872 00000100:00100000:3.0:1787583257.684157:0:19228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435920000 00000100:00100000:3.0:1787583257.684160:0:19228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435920000 00000100:00100000:3.0:1787583257.684167:0:19228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435920384 00000100:00100000:3.0:1787583257.684169:0:19228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435920384 00000100:00100000:3.0:1787583257.684178:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787583257.684183:0:19228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3652:x1874416435919872:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787583257.684216:0:19228:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:3.0:1787583257.684243:0:19228:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b75f0 00002000:00100000:3.0:1787583257.684256:0:19228:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90937fbe7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787583257.684261:0:19228:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787583257.684264:0:19228:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787583257.684333:0:19228:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787583257.684355:0:19228:0:(import.c:65:import_set_state_nolock()) ffff90937fbe5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787583257.684396:0:19228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1874416435919872:12345-0@lo:8:kworker.0 Request processed in 211us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583257.684402:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787583257.684415:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787583257.684430:0:19228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3652:x1874416435920000:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787583257.684445:0:19228:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:3.0:1787583257.684462:0:19228:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a47956376b75f7 00002000:00100000:3.0:1787583257.684468:0:19228:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff909351804800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787583257.684471:0:19228:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787583257.684473:0:19228:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787583257.684609:0:19228:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787583257.684622:0:19228:0:(import.c:65:import_set_state_nolock()) ffff909351807000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787583257.684651:0:19228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1874416435920000:12345-0@lo:8:kworker.0 Request processed in 219us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583257.684657:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787583257.684669:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787583257.684673:0:19228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3652:x1874416435920384:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787583257.684686:0:19228:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:3.0:1787583257.684707:0:19228:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x19a47956376b75fe 00002000:00100000:3.0:1787583257.684713:0:19228:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff909247e49800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787583257.684717:0:19228:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787583257.684719:0:19228:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787583257.684738:0:19228:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787583257.684750:0:19228:0:(import.c:65:import_set_state_nolock()) ffff909352906000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787583257.684791:0:19228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1874416435920384:12345-0@lo:8:kworker.0 Request processed in 116us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583257.684797:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787583257.685068:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247f80e00 x1874416435919872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787583282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583257.685078:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787583257.685086:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787583257.685093:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787583257.685097:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787583257.685099:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909245b04000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787583257.685112:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787583257.685118:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435919872:0@lo:8:kworker.0 00010000:00080000:3.0:1787583257.685130:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247f81c00 x1874416435920000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787583282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583257.685138:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787583257.685141:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787583257.685146:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787583257.685149:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787583257.685151:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909246692000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787583257.685164:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787583257.685175:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874416435920000:0@lo:8:kworker.0 00010000:00080000:3.0:1787583257.685188:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc8b100 x1874416435920384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787583282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787583257.685197:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787583257.685202:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787583257.685205:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787583257.685207:0:3652:0:(import.c:65:import_set_state_nolock()) ffff909247c41800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787583257.685217:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787583257.685220:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874416435920384:0@lo:8:kworker.0 00000004:00080000:3.0:1787583257.685275:0:17178:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1787583257.685293:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17178:1874416435921280:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787583257.685320:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583257.685337:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365c8e180 going to sleep for 11 seconds 00000004:00080000:3.0:1787583257.685351:0:17177:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787583257.685409:0:17177:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 564838562690ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787583257.685415:0:17177:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787583257.685463:0:17180:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1787583257.685476:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17180:1874416435921536:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787583257.685500:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583257.685514:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365c8ed80 going to sleep for 11 seconds 00000004:00080000:3.0:1787583257.685525:0:17897:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787583257.685567:0:17897:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 564838721135ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787583257.685572:0:17897:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787583257.685787:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435921152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787583257.686080:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435921280 00000100:00100000:2.0:1787583257.686087:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435921280 00000100:00100000:2.0:1787583257.686123:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435921536 00000100:00100000:2.0:1787583257.686126:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435921536 00000100:00100000:2.0:1787583257.686139:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787583257.686147:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17178:x1874416435921280:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787583257.689963:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583257.690044:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435921152 00000100:00100000:3.0:1787583257.690059:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435921152 00000100:00100000:3.0:1787583257.690110:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787583257.690120:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1874416435921152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787583257.690143:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787583257.690199:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1874416435921152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (4383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583257.690206:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787583257.690233:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787583257.690242:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17180:x1874416435921536:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787583257.690782:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435921408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583257.690836:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787583257.691569:0:17179:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787583257.691645:0:17179:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 564844798395ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787583257.691652:0:17179:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787583257.691705:0:17898:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787583257.691727:0:17898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17898:1874416435921792:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787583257.692694:0:17898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.692714:0:17898:0:(client.c:2715:ptlrpc_set_wait()) set ffff909346beab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787583257.692729:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583257.692741:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435921664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583257.692768:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.692813:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435921408 00000100:00100000:2.0:1787583257.692828:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435921408 00000100:00100000:2.0:1787583257.693040:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435921664 00000100:00100000:2.0:1787583257.693044:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435921664 00000100:00100000:2.0:1787583257.693066:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787583257.693074:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1874416435921408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787583257.693101:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787583257.693141:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1874416435921408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.693148:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787583257.693163:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787583257.693170:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1874416435921664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787583257.693185:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787583257.693216:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1874416435921664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.693222:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787583257.693240:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787583257.693244:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787583257.693269:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909351691c00 x1874416435921664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583257.693288:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435921664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787583257.693310:0:18661:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787583257.693317:0:18661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1787583257.693411:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435921792 00000100:00100000:2.0:1787583257.693415:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435921792 00000100:00100000:2.0:1787583257.693505:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787583257.693513:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17898:x1874416435921792:12345-0@lo:7:osp-pre-1-1.0 00010000:00080000:3.0:1787583257.693703:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247ee6680 x1874416435921408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583257.693718:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435921408:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787583257.693758:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909247ee7480 x1874416435921152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787583273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787583257.693784:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435921152:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1787583257.694101:0:17886:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1787583257.694286:0:18659:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787583257.694294:0:18659:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787583257.694299:0:18659:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:2.0:1787583257.695158:0:17133:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787583257.705781:0:17133:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1787583257.706562:0:18660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787583257.706570:0:18660:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787583257.706576:0:18660:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:2.0:1787583257.709775:0:19685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787583257.709784:0:19685:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787583257.709892:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17898:x1874416435921792:12345-0@lo:7:osp-pre-1-1.0 Request processed in 16375us (17196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.709904:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787583257.709957:0:17898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909351693800 x1874416435921792/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787583273 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583257.709973:0:17898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17898:1874416435921792:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787583257.709988:0:17898:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787583257.710035:0:17898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17898:1874416435921920:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787583257.710069:0:17898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.710089:0:17898:0:(client.c:2715:ptlrpc_set_wait()) set ffff909346beab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787583257.710107:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435921920 00000100:00100000:2.0:1787583257.710113:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435921920 00000100:00100000:2.0:1787583257.710153:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787583257.710162:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17898:x1874416435921920:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787583257.710185:0:18661:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787583257.710219:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17898:x1874416435921920:12345-0@lo:5:osp-pre-1-1.0 Request processed in 58us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583257.710226:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787583257.710251:0:17898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909351693800 x1874416435921920/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787583273 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583257.710261:0:17898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17898:1874416435921920:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787583257.710271:0:17898:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787583257.710294:0:17898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17898:1874416435922048:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787583257.710316:0:17898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583257.710329:0:17898:0:(client.c:2715:ptlrpc_set_wait()) set ffff909346beab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787583257.710342:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435922048 00000100:00100000:2.0:1787583257.710345:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435922048 00000100:00100000:2.0:1787583257.710361:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787583257.710366:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17898:x1874416435922048:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787583257.710388:0:18661:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1787583257.716082:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.716094:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b7605 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.716109:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.716113:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.716126:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b7605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.716146:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b7605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.716157:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b7605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.716164:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b7605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.716191:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787583257.716398:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583257.716406:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b7605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.716437:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713ec00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.716442:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b7605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.716452:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b7605 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.716470:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b7605 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.716478:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000830474e0/0x19a47956376b7605 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.716500:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.716501:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.716503:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.718020:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.718031:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501e3f14/0x19a47956376b760c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.718045:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.718049:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.718055:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000501e3f14/0x19a47956376b760c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.718067:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000501e3f14/0x19a47956376b760c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.718077:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501e3f14/0x19a47956376b760c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.718096:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000501e3f14/0x19a47956376b760c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.718123:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787583257.718375:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583257.718383:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000501e3f14/0x19a47956376b760c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.718391:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f000 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.718394:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000501e3f14/0x19a47956376b760c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.718404:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000501e3f14/0x19a47956376b760c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.718435:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000501e3f14/0x19a47956376b760c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.718443:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000501e3f14/0x19a47956376b760c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.718461:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.718463:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.718465:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.719956:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.719966:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b7613 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.719980:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.719984:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.719990:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b7613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.720002:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b7613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.720011:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b7613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.720019:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b7613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.720067:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787583257.720207:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583257.720213:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b7613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.720222:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.720226:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b7613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.720235:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b7613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.720249:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b7613 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.720256:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd101458/0x19a47956376b7613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.720285:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.720286:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.720288:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.720535:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.720541:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005116cc9e/0x19a47956376b761a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.720555:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.720558:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.720562:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005116cc9e/0x19a47956376b761a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.720570:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005116cc9e/0x19a47956376b761a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.720578:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005116cc9e/0x19a47956376b761a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.720585:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005116cc9e/0x19a47956376b761a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.720600:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787583257.720985:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.720992:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f9940e/0x19a47956376b7621 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721001:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.721005:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.721009:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f9940e/0x19a47956376b7621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721018:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2f9940e/0x19a47956376b7621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721037:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f9940e/0x19a47956376b7621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721044:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f9940e/0x19a47956376b7621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721062:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787583257.721068:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787583257.721072:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005116cc9e/0x19a47956376b761a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721080:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340031c00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.721084:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005116cc9e/0x19a47956376b761a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721092:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005116cc9e/0x19a47956376b761a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721103:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005116cc9e/0x19a47956376b761a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721111:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005116cc9e/0x19a47956376b761a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721127:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583257.721135:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2f9940e/0x19a47956376b7621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721141:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340031400 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.721144:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f9940e/0x19a47956376b7621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721152:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f9940e/0x19a47956376b7621 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721163:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2f9940e/0x19a47956376b7621 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721169:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2f9940e/0x19a47956376b7621 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.721181:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.721183:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.721185:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.723541:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.723552:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1279f4a/0x19a47956376b7628 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.723569:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.723574:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.723580:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1279f4a/0x19a47956376b7628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.723604:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1279f4a/0x19a47956376b7628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.723615:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1279f4a/0x19a47956376b7628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.723623:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1279f4a/0x19a47956376b7628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.723639:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787583257.723649:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583257.723653:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1279f4a/0x19a47956376b7628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.723661:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340031600 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.723665:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1279f4a/0x19a47956376b7628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.723674:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1279f4a/0x19a47956376b7628 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.723689:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1279f4a/0x19a47956376b7628 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.723696:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1279f4a/0x19a47956376b7628 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.723733:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.723735:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.723737:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787583257.724200:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.724208:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082fb7366/0x19a47956376b762f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.724229:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.724232:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.724237:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082fb7366/0x19a47956376b762f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.724249:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082fb7366/0x19a47956376b762f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.724257:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082fb7366/0x19a47956376b762f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.724265:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082fb7366/0x19a47956376b762f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.724278:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787583257.724286:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.724289:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082fb7366/0x19a47956376b762f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.724295:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248497400 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.724298:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082fb7366/0x19a47956376b762f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.724306:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082fb7366/0x19a47956376b762f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.724327:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082fb7366/0x19a47956376b762f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.724333:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082fb7366/0x19a47956376b762f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.724348:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.724349:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.724351:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.724669:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.724675:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005abe5bd8/0x19a47956376b7636 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.724682:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.724685:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.724690:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005abe5bd8/0x19a47956376b7636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.724700:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005abe5bd8/0x19a47956376b7636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.724720:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005abe5bd8/0x19a47956376b7636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.724727:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005abe5bd8/0x19a47956376b7636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.724745:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787583257.725102:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.725108:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f9653e/0x19a47956376b763d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.725128:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.725131:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.725136:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030f9653e/0x19a47956376b763d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.725145:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030f9653e/0x19a47956376b763d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.725153:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f9653e/0x19a47956376b763d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.725160:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030f9653e/0x19a47956376b763d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.725169:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787583257.725433:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.725440:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727cc85f/0x19a47956376b7644 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.725448:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.725451:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.725455:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000727cc85f/0x19a47956376b7644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.725464:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000727cc85f/0x19a47956376b7644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.725481:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727cc85f/0x19a47956376b7644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.725489:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000727cc85f/0x19a47956376b7644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.725498:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787583257.725804:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787583257.725811:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005abe5bd8/0x19a47956376b7636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.725820:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340030800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.725824:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005abe5bd8/0x19a47956376b7636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.725833:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005abe5bd8/0x19a47956376b7636 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787583257.725976:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.725982:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008315d50/0x19a47956376b764b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.725990:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.725994:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.725998:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008315d50/0x19a47956376b764b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.726007:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008315d50/0x19a47956376b764b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.726015:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008315d50/0x19a47956376b764b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.726023:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008315d50/0x19a47956376b764b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.726042:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787583257.726238:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005abe5bd8/0x19a47956376b7636 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726247:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005abe5bd8/0x19a47956376b7636 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726278:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787583257.726282:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030f9653e/0x19a47956376b763d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726289:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340030600 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.726292:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f9653e/0x19a47956376b763d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726299:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f9653e/0x19a47956376b763d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726309:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030f9653e/0x19a47956376b763d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726315:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030f9653e/0x19a47956376b763d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726326:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787583257.726329:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000727cc85f/0x19a47956376b7644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726335:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340030e00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.726338:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000727cc85f/0x19a47956376b7644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726356:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000727cc85f/0x19a47956376b7644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726366:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000727cc85f/0x19a47956376b7644 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726373:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000727cc85f/0x19a47956376b7644 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726386:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.726389:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008315d50/0x19a47956376b764b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726395:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340031800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.726398:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008315d50/0x19a47956376b764b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726405:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008315d50/0x19a47956376b764b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726415:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008315d50/0x19a47956376b764b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726430:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008315d50/0x19a47956376b764b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726456:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.726458:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.726460:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787583257.726517:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.726522:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5ba0877/0x19a47956376b7652 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726531:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.726535:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.726539:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5ba0877/0x19a47956376b7652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726549:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5ba0877/0x19a47956376b7652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726557:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5ba0877/0x19a47956376b7652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726565:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5ba0877/0x19a47956376b7652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726579:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787583257.726586:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.726590:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5ba0877/0x19a47956376b7652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726608:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248497000 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.726611:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5ba0877/0x19a47956376b7652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726619:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5ba0877/0x19a47956376b7652 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726630:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5ba0877/0x19a47956376b7652 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726637:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5ba0877/0x19a47956376b7652 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.726650:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.726652:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.726654:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.726837:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787583257.727056:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.727092:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006bb188a/0x19a47956376b7659 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.727102:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.727106:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.727110:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006bb188a/0x19a47956376b7659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.727121:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006bb188a/0x19a47956376b7659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.727128:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006bb188a/0x19a47956376b7659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.727135:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006bb188a/0x19a47956376b7659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.727155:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787583257.727469:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583257.727474:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006bb188a/0x19a47956376b7659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.727482:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340031200 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.727486:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006bb188a/0x19a47956376b7659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.727494:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006bb188a/0x19a47956376b7659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.727506:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006bb188a/0x19a47956376b7659 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.727513:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006bb188a/0x19a47956376b7659 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.727530:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.727532:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.727534:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.727611:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.727617:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3b6752/0x19a47956376b7660 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.727626:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.727635:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.727639:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3b6752/0x19a47956376b7660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.727649:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb3b6752/0x19a47956376b7660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.727657:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3b6752/0x19a47956376b7660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.727665:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3b6752/0x19a47956376b7660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787583257.727905:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.727912:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b7667 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.727921:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.727924:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.727928:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b7667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.727938:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b7667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.727952:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b7667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.727959:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b7667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.727998:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787583257.728412:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.728429:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee3d876e/0x19a47956376b766e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.728437:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.728440:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.728444:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee3d876e/0x19a47956376b766e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.728454:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee3d876e/0x19a47956376b766e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.728461:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee3d876e/0x19a47956376b766e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.728475:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee3d876e/0x19a47956376b766e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728538:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787583257.728543:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb3b6752/0x19a47956376b7660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728556:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909340031a00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.728560:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3b6752/0x19a47956376b7660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728568:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3b6752/0x19a47956376b7660 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728580:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb3b6752/0x19a47956376b7660 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728588:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb3b6752/0x19a47956376b7660 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728604:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787583257.728608:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b7667 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728614:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.728617:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b7667 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728624:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b7667 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728636:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b7667 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728648:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583257.728651:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee3d876e/0x19a47956376b766e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728656:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.728659:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee3d876e/0x19a47956376b766e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728666:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee3d876e/0x19a47956376b766e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728675:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee3d876e/0x19a47956376b766e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.728682:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.728683:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.728686:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.728819:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787583257.728824:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b7667 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.729274:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787583257.729280:0:18659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee3d876e/0x19a47956376b766e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787583257.729582:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.729590:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bff44eff/0x19a47956376b7675 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.729600:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.729604:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.729609:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bff44eff/0x19a47956376b7675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.729620:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bff44eff/0x19a47956376b7675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.729629:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bff44eff/0x19a47956376b7675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.729637:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bff44eff/0x19a47956376b7675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.729656:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787583257.729987:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.729993:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcde0114/0x19a47956376b767c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.730002:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.730005:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.730009:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcde0114/0x19a47956376b767c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.730019:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcde0114/0x19a47956376b767c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.730027:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcde0114/0x19a47956376b767c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.730036:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcde0114/0x19a47956376b767c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.730043:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787583257.730319:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787583257.730325:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bff44eff/0x19a47956376b7675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.730333:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1c00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.730337:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bff44eff/0x19a47956376b7675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.730345:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bff44eff/0x19a47956376b7675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.730360:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bff44eff/0x19a47956376b7675 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.730366:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bff44eff/0x19a47956376b7675 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.730389:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.730392:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcde0114/0x19a47956376b767c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.730398:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1600 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.730401:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcde0114/0x19a47956376b767c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.730408:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcde0114/0x19a47956376b767c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.730429:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcde0114/0x19a47956376b767c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.730436:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcde0114/0x19a47956376b767c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.730449:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.730451:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.730453:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.730751:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.730758:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072fabb4d/0x19a47956376b7683 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.730767:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.730775:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.730780:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072fabb4d/0x19a47956376b7683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.730791:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072fabb4d/0x19a47956376b7683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.730798:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072fabb4d/0x19a47956376b7683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.730806:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072fabb4d/0x19a47956376b7683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.730820:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787583257.731062:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.731067:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5a64276/0x19a47956376b768a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.731075:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.731078:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.731083:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5a64276/0x19a47956376b768a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.731091:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5a64276/0x19a47956376b768a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.731099:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5a64276/0x19a47956376b768a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.731112:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5a64276/0x19a47956376b768a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.731127:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787583257.731414:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787583257.731448:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072fabb4d/0x19a47956376b7683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.731456:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0600 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.731464:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072fabb4d/0x19a47956376b7683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.731473:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072fabb4d/0x19a47956376b7683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.731485:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072fabb4d/0x19a47956376b7683 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.731493:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072fabb4d/0x19a47956376b7683 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.731507:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.731511:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5a64276/0x19a47956376b768a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.731517:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1400 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.731520:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5a64276/0x19a47956376b768a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.731529:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5a64276/0x19a47956376b768a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.731538:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5a64276/0x19a47956376b768a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.731545:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5a64276/0x19a47956376b768a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.731561:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.731563:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.731564:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.731783:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.731789:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad27f7bc/0x19a47956376b7691 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.731798:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.731801:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.731805:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad27f7bc/0x19a47956376b7691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.731815:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad27f7bc/0x19a47956376b7691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.731822:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad27f7bc/0x19a47956376b7691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.731830:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad27f7bc/0x19a47956376b7691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.731841:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787583257.732956:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.732964:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad27f7bc/0x19a47956376b7691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.732976:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1200 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.732980:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad27f7bc/0x19a47956376b7691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.732989:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad27f7bc/0x19a47956376b7691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733004:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad27f7bc/0x19a47956376b7691 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733012:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad27f7bc/0x19a47956376b7691 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733030:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.733031:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.733033:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787583257.733081:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.733087:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7698 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733107:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.733111:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.733117:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733127:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733146:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733155:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733171:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787583257.733178:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.733182:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733189:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367ec00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.733192:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733199:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7698 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733219:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7698 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733226:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7698 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.733239:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.733241:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.733243:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787583257.734488:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.734498:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd365ec/0x19a47956376b769f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.734512:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.734516:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.734522:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd365ec/0x19a47956376b769f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.734533:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd365ec/0x19a47956376b769f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.734541:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd365ec/0x19a47956376b769f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.734549:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cd365ec/0x19a47956376b769f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.734576:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787583257.734585:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.734589:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cd365ec/0x19a47956376b769f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.734597:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e400 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.734601:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd365ec/0x19a47956376b769f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.734610:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd365ec/0x19a47956376b769f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.734624:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cd365ec/0x19a47956376b769f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.734632:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd365ec/0x19a47956376b769f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.734646:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.734647:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.734649:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.735303:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.735311:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cd199dc/0x19a47956376b76a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.735327:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.735331:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.735336:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cd199dc/0x19a47956376b76a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.735347:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cd199dc/0x19a47956376b76a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.735355:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cd199dc/0x19a47956376b76a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.735363:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cd199dc/0x19a47956376b76a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.735378:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787583257.735532:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.735537:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cd199dc/0x19a47956376b76a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.735545:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.735554:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cd199dc/0x19a47956376b76a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.735561:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cd199dc/0x19a47956376b76a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.735572:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cd199dc/0x19a47956376b76a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.735579:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cd199dc/0x19a47956376b76a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.735593:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.735595:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.735596:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.735817:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.736197:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.736204:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f64b140/0x19a47956376b76ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736215:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.736218:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.736223:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f64b140/0x19a47956376b76ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736234:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f64b140/0x19a47956376b76ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736254:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f64b140/0x19a47956376b76ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736262:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f64b140/0x19a47956376b76ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736275:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787583257.736638:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.736644:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb32d5d5/0x19a47956376b76b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736653:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.736656:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.736660:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb32d5d5/0x19a47956376b76b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736670:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb32d5d5/0x19a47956376b76b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736677:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb32d5d5/0x19a47956376b76b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736685:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb32d5d5/0x19a47956376b76b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736722:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787583257.736731:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787583257.736735:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f64b140/0x19a47956376b76ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736743:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0a00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.736747:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f64b140/0x19a47956376b76ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736755:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f64b140/0x19a47956376b76ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736768:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f64b140/0x19a47956376b76ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736776:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f64b140/0x19a47956376b76ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736792:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583257.736796:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb32d5d5/0x19a47956376b76b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736802:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0400 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.736806:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb32d5d5/0x19a47956376b76b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736824:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb32d5d5/0x19a47956376b76b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736835:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb32d5d5/0x19a47956376b76b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736842:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb32d5d5/0x19a47956376b76b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.736888:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.736890:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.736892:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.737230:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.737237:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033cacd30/0x19a47956376b76bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.737245:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.737248:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.737252:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033cacd30/0x19a47956376b76bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.737261:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033cacd30/0x19a47956376b76bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.737269:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033cacd30/0x19a47956376b76bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.737283:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033cacd30/0x19a47956376b76bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.737296:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787583257.737304:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583257.737308:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033cacd30/0x19a47956376b76bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.737315:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0000 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.737319:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033cacd30/0x19a47956376b76bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.737327:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033cacd30/0x19a47956376b76bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.737337:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033cacd30/0x19a47956376b76bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.737345:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033cacd30/0x19a47956376b76bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.737358:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.737360:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.737362:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.737594:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787583257.737642:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.737649:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc09be41/0x19a47956376b76c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.737657:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.737661:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.737665:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc09be41/0x19a47956376b76c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.737675:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc09be41/0x19a47956376b76c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.737695:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc09be41/0x19a47956376b76c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.737702:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc09be41/0x19a47956376b76c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.737731:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787583257.738152:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583257.738163:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc09be41/0x19a47956376b76c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738171:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367ee00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.738174:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc09be41/0x19a47956376b76c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738182:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc09be41/0x19a47956376b76c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738195:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc09be41/0x19a47956376b76c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738202:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc09be41/0x19a47956376b76c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738216:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.738218:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.738219:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787583257.738348:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.738354:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034c3f82f/0x19a47956376b76c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.738363:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.738366:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.738370:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034c3f82f/0x19a47956376b76c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.738380:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034c3f82f/0x19a47956376b76c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.738387:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034c3f82f/0x19a47956376b76c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.738394:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034c3f82f/0x19a47956376b76c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.738433:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787583257.738441:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.738444:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034c3f82f/0x19a47956376b76c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.738451:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367fa00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.738454:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034c3f82f/0x19a47956376b76c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.738461:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034c3f82f/0x19a47956376b76c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.738472:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034c3f82f/0x19a47956376b76c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.738478:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034c3f82f/0x19a47956376b76c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.738488:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.738490:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.738491:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.738752:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.738758:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ab6d2b5/0x19a47956376b76d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738767:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.738770:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.738775:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ab6d2b5/0x19a47956376b76d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738794:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ab6d2b5/0x19a47956376b76d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738803:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ab6d2b5/0x19a47956376b76d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738811:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ab6d2b5/0x19a47956376b76d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738823:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787583257.738830:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583257.738834:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ab6d2b5/0x19a47956376b76d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738841:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0200 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.738962:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab6d2b5/0x19a47956376b76d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738973:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab6d2b5/0x19a47956376b76d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738985:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ab6d2b5/0x19a47956376b76d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.738993:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ab6d2b5/0x19a47956376b76d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739012:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.739014:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.739016:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.739312:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.739318:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc1aa1a4/0x19a47956376b76d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739327:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.739330:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.739335:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1aa1a4/0x19a47956376b76d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739345:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc1aa1a4/0x19a47956376b76d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739354:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc1aa1a4/0x19a47956376b76d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739362:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1aa1a4/0x19a47956376b76d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739377:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787583257.739543:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.739549:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc1aa1a4/0x19a47956376b76d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.739556:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1e00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.739565:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc1aa1a4/0x19a47956376b76d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.739573:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc1aa1a4/0x19a47956376b76d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.739584:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc1aa1a4/0x19a47956376b76d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.739591:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc1aa1a4/0x19a47956376b76d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.739605:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.739607:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.739608:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.739871:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.739876:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b76de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739894:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.739897:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.739902:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b76de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739911:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b76de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739919:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b76de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739927:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b76de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739940:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787583257.739947:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583257.739951:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b76de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739957:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1000 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.739960:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b76de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739967:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b76de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739988:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b76de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.739995:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b76de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.740008:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.740009:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.740011:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787583257.742917:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787583257.742931:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abee7ace/0x19a47956376b76e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.742949:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787583257.742953:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583257.742960:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abee7ace/0x19a47956376b76e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.742987:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abee7ace/0x19a47956376b76e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.742998:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abee7ace/0x19a47956376b76e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.743006:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abee7ace/0x19a47956376b76e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.743028:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787583257.743313:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583257.743320:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abee7ace/0x19a47956376b76e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.743329:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dece00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.743334:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abee7ace/0x19a47956376b76e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.743343:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abee7ace/0x19a47956376b76e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.743360:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abee7ace/0x19a47956376b76e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.743368:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abee7ace/0x19a47956376b76e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.743396:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.743398:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.743399:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.744056:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.744063:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b02542fb/0x19a47956376b76ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.744076:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.744080:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.744085:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b02542fb/0x19a47956376b76ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.744095:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b02542fb/0x19a47956376b76ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.744104:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b02542fb/0x19a47956376b76ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.744112:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b02542fb/0x19a47956376b76ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.744124:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787583257.744398:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583257.744404:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b02542fb/0x19a47956376b76ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.744412:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0c00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.744425:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b02542fb/0x19a47956376b76ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.744435:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b02542fb/0x19a47956376b76ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.744449:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b02542fb/0x19a47956376b76ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.744457:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b02542fb/0x19a47956376b76ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.744482:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.744484:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.744486:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787583257.744819:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787583257.744825:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e171271/0x19a47956376b76f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.744835:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787583257.744839:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583257.744931:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e171271/0x19a47956376b76f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.744944:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e171271/0x19a47956376b76f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.744953:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e171271/0x19a47956376b76f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.744962:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e171271/0x19a47956376b76f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.744977:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787583257.745203:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583257.745209:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e171271/0x19a47956376b76f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.745228:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344deca00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.745232:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e171271/0x19a47956376b76f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.745241:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e171271/0x19a47956376b76f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.745253:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e171271/0x19a47956376b76f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.745262:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e171271/0x19a47956376b76f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.745278:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.745280:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.745282:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.746074:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.746082:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040e37ed/0x19a47956376b76fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746093:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.746096:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.746101:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040e37ed/0x19a47956376b76fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746112:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040e37ed/0x19a47956376b76fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746127:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040e37ed/0x19a47956376b76fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746184:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040e37ed/0x19a47956376b76fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746203:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787583257.746212:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583257.746216:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040e37ed/0x19a47956376b76fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746223:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1a00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.746227:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040e37ed/0x19a47956376b76fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746235:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040e37ed/0x19a47956376b76fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746246:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040e37ed/0x19a47956376b76fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746253:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040e37ed/0x19a47956376b76fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746267:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.746274:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.746276:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.746582:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.746588:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e42aa50d/0x19a47956376b7701 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746596:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.746599:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.746603:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e42aa50d/0x19a47956376b7701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746612:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e42aa50d/0x19a47956376b7701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746620:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e42aa50d/0x19a47956376b7701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746626:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e42aa50d/0x19a47956376b7701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746638:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787583257.746645:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583257.746650:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e42aa50d/0x19a47956376b7701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746656:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0e00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.746660:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42aa50d/0x19a47956376b7701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746678:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42aa50d/0x19a47956376b7701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746689:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e42aa50d/0x19a47956376b7701 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746695:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e42aa50d/0x19a47956376b7701 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.746718:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.746720:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.746721:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787583257.748382:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.748395:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd365ec/0x19a47956376b7708 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.748411:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.748426:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.748433:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd365ec/0x19a47956376b7708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.748448:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd365ec/0x19a47956376b7708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.748458:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd365ec/0x19a47956376b7708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.748474:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cd365ec/0x19a47956376b7708 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.748495:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787583257.748739:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787583257.748746:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9ad6d7/0x19a47956376b770f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.748766:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787583257.748770:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583257.748775:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9ad6d7/0x19a47956376b770f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.748785:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9ad6d7/0x19a47956376b770f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.748794:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9ad6d7/0x19a47956376b770f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.748802:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c9ad6d7/0x19a47956376b770f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.748817:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787583257.750932:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787583257.750943:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cd365ec/0x19a47956376b7708 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.750957:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e400 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.750962:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd365ec/0x19a47956376b7708 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.750973:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd365ec/0x19a47956376b7708 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.750993:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cd365ec/0x19a47956376b7708 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.751011:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd365ec/0x19a47956376b7708 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.751033:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787583257.751037:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c9ad6d7/0x19a47956376b770f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.751044:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec600 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583257.751048:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9ad6d7/0x19a47956376b770f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.751055:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9ad6d7/0x19a47956376b770f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.751066:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c9ad6d7/0x19a47956376b770f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.751074:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9ad6d7/0x19a47956376b770f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.751088:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.751089:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.751091:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.751097:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787583257.751235:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.751242:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7716 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.751252:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.751256:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.751261:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.751273:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.751283:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.751290:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.751310:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787583257.753276:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.753287:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b771d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753310:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.753314:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.753320:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b771d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753332:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b771d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753341:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b771d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753349:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b771d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753368:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787583257.753378:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787583257.753384:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753392:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367ec00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.753397:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753404:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753443:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7716 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753450:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080f6d8bd/0x19a47956376b7716 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753470:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.753474:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b771d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753480:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.753483:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b771d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753490:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b771d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753498:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b771d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753503:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d9ba565/0x19a47956376b771d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.753512:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.753513:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.753520:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583257.754069:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787583257.755034:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.755053:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b7724 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.755067:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.755071:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.755077:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b7724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.755089:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b7724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.755099:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b7724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.755106:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b7724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.755123:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787583257.755288:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787583257.755295:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b7724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.755303:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1000 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787583257.755307:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b7724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.755315:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b7724 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.755335:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b7724 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.755342:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f04892de/0x19a47956376b7724 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.755361:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583257.755363:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583257.755365:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787583257.755964:0:19474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787583257.755994:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787583257.756000:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1787583257.758453:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787583257.758467:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a594b1e/0x19a47956376b772b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583257.758479:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17898:x1874416435922048:12345-0@lo:5:osp-pre-1-1.0 Request processed in 48108us (48158us total) trans 8589934593 rc 0/0 00010000:00010000:1.0:1787583257.758483:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=564s v=(0 0) 00000100:00100000:0.0:1787583257.758490:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1787583257.758494:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583257.758500:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a594b1e/0x19a47956376b772b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.758513:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a594b1e/0x19a47956376b772b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.758523:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a594b1e/0x19a47956376b772b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.758530:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a594b1e/0x19a47956376b772b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.758547:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787583257.758554:0:17898:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787583257.758561:0:17898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17898:1874416435922048:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787583257.758575:0:17898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787583257.758628:0:17898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17898:1874416435922176:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787583257.758678:0:17898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583257.758705:0:17898:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092464983c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583257.758731:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435922176 00000100:00100000:0.0:1787583257.758737:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435922176 00000100:00100000:0.0:1787583257.758771:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787583257.758779:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17898:x1874416435922176:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787583257.758826:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17898:x1874416435922176:12345-0@lo:900:osp-pre-1-1.0 Request processed in 48us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583257.758832:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787583257.758898:0:17898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fce8000 x1874416435922176/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787583273 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787583257.758908:0:17898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17898:1874416435922176:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1787583257.759888:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787583257.759899:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004201f729/0x19a47956376b7732 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.759912:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787583257.759916:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583257.759922:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004201f729/0x19a47956376b7732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.759934:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004201f729/0x19a47956376b7732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.759943:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004201f729/0x19a47956376b7732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.759957:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004201f729/0x19a47956376b7732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.759976:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787583257.760449:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787583257.760455:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ffed062/0x19a47956376b7739 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.760464:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787583257.760467:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583257.760472:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ffed062/0x19a47956376b7739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.760480:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ffed062/0x19a47956376b7739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.760488:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ffed062/0x19a47956376b7739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.760495:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ffed062/0x19a47956376b7739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.760505:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787583257.761429:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787583257.761438:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7481873/0x19a47956376b7740 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.761456:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787583257.761459:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583257.761464:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7481873/0x19a47956376b7740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.761475:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7481873/0x19a47956376b7740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.761484:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7481873/0x19a47956376b7740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.761492:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7481873/0x19a47956376b7740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.761501:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787583257.762081:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787583257.762088:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c85fa978/0x19a47956376b7747 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.762097:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787583257.762100:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583257.762104:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c85fa978/0x19a47956376b7747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.762114:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c85fa978/0x19a47956376b7747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.762132:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c85fa978/0x19a47956376b7747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.762192:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c85fa978/0x19a47956376b7747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.762483:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1787583257.763970:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787583257.763982:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a594b1e/0x19a47956376b772b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.763993:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53e00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.763998:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a594b1e/0x19a47956376b772b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764008:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a594b1e/0x19a47956376b772b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764027:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a594b1e/0x19a47956376b772b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764034:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a594b1e/0x19a47956376b772b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764052:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787583257.764056:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004201f729/0x19a47956376b7732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764063:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52e00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.764065:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004201f729/0x19a47956376b7732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764073:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004201f729/0x19a47956376b7732 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764092:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004201f729/0x19a47956376b7732 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764099:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004201f729/0x19a47956376b7732 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764113:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787583257.764116:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ffed062/0x19a47956376b7739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764123:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53a00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.764126:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ffed062/0x19a47956376b7739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764132:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ffed062/0x19a47956376b7739 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764228:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ffed062/0x19a47956376b7739 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764236:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ffed062/0x19a47956376b7739 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764249:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787583257.764252:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7481873/0x19a47956376b7740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764266:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c52600 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.764269:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7481873/0x19a47956376b7740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764277:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7481873/0x19a47956376b7740 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764287:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7481873/0x19a47956376b7740 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764294:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7481873/0x19a47956376b7740 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764305:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.764309:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c85fa978/0x19a47956376b7747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764316:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53600 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.764319:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c85fa978/0x19a47956376b7747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764327:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c85fa978/0x19a47956376b7747 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764336:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c85fa978/0x19a47956376b7747 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764347:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c85fa978/0x19a47956376b7747 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.764359:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.764361:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.764363:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.764566:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787583257.765918:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787583257.765930:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000817160e9/0x19a47956376b774e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.765946:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787583257.765950:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583257.765956:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817160e9/0x19a47956376b774e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.765973:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000817160e9/0x19a47956376b774e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.765982:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000817160e9/0x19a47956376b774e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.765990:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000817160e9/0x19a47956376b774e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.766014:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787583257.766018:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787583257.766024:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000817160e9/0x19a47956376b774e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.766031:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924149ae00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:3.0:1787583257.766035:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000817160e9/0x19a47956376b774e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.766043:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000817160e9/0x19a47956376b774e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.766056:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000817160e9/0x19a47956376b774e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.766063:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000817160e9/0x19a47956376b774e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.766078:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.766080:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.766081:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787583257.766863:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787583257.766870:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005412823d/0x19a47956376b7755 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.766881:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787583257.766884:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583257.766889:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005412823d/0x19a47956376b7755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.766900:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005412823d/0x19a47956376b7755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.766908:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005412823d/0x19a47956376b7755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.766916:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005412823d/0x19a47956376b7755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.766936:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787583257.766945:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583257.766951:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005412823d/0x19a47956376b7755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.766958:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924149a800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.766962:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005412823d/0x19a47956376b7755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.766970:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005412823d/0x19a47956376b7755 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.766993:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005412823d/0x19a47956376b7755 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.767000:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005412823d/0x19a47956376b7755 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.767014:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.767016:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.767018:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787583257.767130:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.768040:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034c3f82f/0x19a47956376b775c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.768053:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.768057:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.768062:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034c3f82f/0x19a47956376b775c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.768074:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034c3f82f/0x19a47956376b775c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.768083:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034c3f82f/0x19a47956376b775c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.768091:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034c3f82f/0x19a47956376b775c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.768192:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787583257.768373:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787583257.768380:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7fdc82f/0x19a47956376b7763 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.768389:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787583257.768398:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583257.768404:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7fdc82f/0x19a47956376b7763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.768413:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7fdc82f/0x19a47956376b7763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.768432:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7fdc82f/0x19a47956376b7763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.768439:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7fdc82f/0x19a47956376b7763 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787583257.769331:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.769341:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfbba7c/0x19a47956376b776a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.769353:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.769357:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.769362:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cfbba7c/0x19a47956376b776a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.769384:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cfbba7c/0x19a47956376b776a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.769393:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfbba7c/0x19a47956376b776a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.769400:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cfbba7c/0x19a47956376b776a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769594:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787583257.769602:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034c3f82f/0x19a47956376b775c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769611:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367fa00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.769615:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034c3f82f/0x19a47956376b775c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769624:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034c3f82f/0x19a47956376b775c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769639:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034c3f82f/0x19a47956376b775c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769647:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034c3f82f/0x19a47956376b775c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769675:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787583257.769680:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7fdc82f/0x19a47956376b7763 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769686:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924149bc00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.769689:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7fdc82f/0x19a47956376b7763 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769696:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7fdc82f/0x19a47956376b7763 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769706:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7fdc82f/0x19a47956376b7763 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769712:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583257.769715:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cfbba7c/0x19a47956376b776a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769721:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f200 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.769724:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfbba7c/0x19a47956376b776a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769731:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfbba7c/0x19a47956376b776a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769750:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cfbba7c/0x19a47956376b776a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.769758:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.769759:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.769762:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583257.769814:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787583257.769820:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7fdc82f/0x19a47956376b7763 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787583257.770250:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787583257.770258:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046040766/0x19a47956376b7771 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.770267:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787583257.770270:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583257.770275:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046040766/0x19a47956376b7771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.770285:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046040766/0x19a47956376b7771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.770301:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046040766/0x19a47956376b7771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.770307:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046040766/0x19a47956376b7771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583257.770320:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787583257.770350:0:18660:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1787583257.770447:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17180:x1874416435921536:12345-0@lo:5:osp-pre-1-0.0 Request processed in 80203us (84943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583257.770457:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787583257.770509:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17180:1874416435921536:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787583257.770525:0:17180:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1787583257.770568:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348840000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17180:1874416435922304:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787583257.770598:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583257.770619:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247060540 going to sleep for 11 seconds 00000100:00100000:1.0:1787583257.770634:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435922304 00000100:00100000:1.0:1787583257.770641:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435922304 00000100:00100000:1.0:1787583257.770674:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787583257.770682:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17180:x1874416435922304:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1787583257.770699:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583257.770704:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046040766/0x19a47956376b7771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.770712:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924149b600 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.770717:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046040766/0x19a47956376b7771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787583257.770723:0:19685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1787583257.770725:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046040766/0x19a47956376b7771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.770737:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046040766/0x19a47956376b7771 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.770743:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046040766/0x19a47956376b7771 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.770756:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.770757:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.770759:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.771693:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.774276:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787583257.774287:0:18659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cfbba7c/0x19a47956376b776a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583257.777125:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17180:x1874416435922304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5520us (5603us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787583257.777184:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787583257.777323:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348840000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17180:1874416435922304:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787583257.777338:0:17180:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00002000:00010000:0.0:1787583257.778039:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787583257.778048:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e42aa50d/0x19a47956376b7778 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.778065:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787583257.778069:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583257.778074:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e42aa50d/0x19a47956376b7778 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.778088:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e42aa50d/0x19a47956376b7778 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.778111:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e42aa50d/0x19a47956376b7778 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583257.778118:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e42aa50d/0x19a47956376b7778 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.779728:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583257.779740:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e42aa50d/0x19a47956376b7778 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.779752:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0e00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.779757:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e42aa50d/0x19a47956376b7778 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.779767:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e42aa50d/0x19a47956376b7778 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.779787:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e42aa50d/0x19a47956376b7778 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.779797:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.779799:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.779801:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583257.780308:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787583257.780317:0:18659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e42aa50d/0x19a47956376b7778 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787583257.785609:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787583257.785624:0:18659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d9ba565/0x19a47956376b777f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.785643:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787583257.785647:0:18659:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583257.785653:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d9ba565/0x19a47956376b777f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.785668:0:18659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d9ba565/0x19a47956376b777f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.785690:0:18659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d9ba565/0x19a47956376b777f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.785699:0:18659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d9ba565/0x19a47956376b777f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.786414:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787583257.786433:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d9ba565/0x19a47956376b777f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.786443:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e800 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583257.786448:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d9ba565/0x19a47956376b777f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.786457:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d9ba565/0x19a47956376b777f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583257.786488:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d9ba565/0x19a47956376b777f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583257.786587:0:18659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787583257.786593:0:18659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d9ba565/0x19a47956376b777f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787583257.786686:0:18659:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1787583257.786820:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17178:x1874416435921280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 100670us (101495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583257.786829:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787583257.789004:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787583257.789011:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583257.789055:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583257.790011:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17178:1874416435921280:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787583257.790032:0:17178:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787583257.790084:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17178:1874416435922432:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787583257.790141:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583257.790177:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247060540 going to sleep for 11 seconds 00000100:00100000:1.0:1787583257.790205:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435922432 00000100:00100000:1.0:1787583257.790212:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435922432 00000100:00100000:1.0:1787583257.790257:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787583257.790267:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17178:x1874416435922432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787583257.790304:0:18661:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1787583257.793362:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787583257.799080:0:18655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1787583257.799124:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787583257.800067:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17178:x1874416435922432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9795us (9918us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787583257.800078:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787583257.800303:0:17178:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787583257.800311:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909348842a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17178:1874416435922432:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787583257.800325:0:17178:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1787583258.447959:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787583258.830489:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787583259.472214:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787583259.611972:0:19830:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1787583260.294495:0:19882:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787583260.294817:0:19882:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787583260.496122:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787583261.022782:0:19932:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787583261.023463:0:19932:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787583261.134034:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435922560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787583261.134102:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583261.134342:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435922560 00000100:00100000:0.0:1787583261.134350:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435922560 00000100:00100000:0.0:1787583261.134420:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787583261.134430:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435922560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583261.134467:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787583261.134515:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435922560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583261.134522:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787583261.134706:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787583261.134743:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435922560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583261.253926:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583261.254342:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413820544 00000100:00100000:0.0:1787583261.254353:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413820544 00000100:00100000:0.0:1787583261.254408:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:0.0:1787583261.254417:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2403:x1874416413820544:12345-192.168.203.11@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787583261.254448:0:17148:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d9d5ba4b-a209-427f-bc83-827ad63e227c@192.168.203.11@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:0.0:1787583261.254493:0:17148:0:(genops.c:1385:class_connect()) connect: client d9d5ba4b-a209-427f-bc83-827ad63e227c, cookie 0x19a47956376b7786 00000100:00080000:0.0:1787583261.254640:0:17148:0:(import.c:65:import_set_state_nolock()) ffff909247e55000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787583261.254713:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+5:2403:x1874416413820544:12345-192.168.203.11@tcp:250:mount.lustre.0 Request processed in 296us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583261.254722:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:0.0:1787583261.262734:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583261.264826:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413820672 00000100:00100000:3.0:1787583261.264881:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413820672 00000100:00100000:3.0:1787583261.264948:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:3.0:1787583261.264960:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+5:14909:x1874416413820672:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787583261.264977:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583261.264993:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367e800/0x19a47956376b778d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4558 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583261.265021:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367e800/0x19a47956376b778d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4558 expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583261.265032:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367e800/0x19a47956376b778d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4558 expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583261.265041:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367e800, rc 0) 00000100:00100000:3.0:1787583261.265107:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+6:14909:x1874416413820672:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 150us (2381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583261.265115:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:3.0:1787583261.270614:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583261.270742:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413820800 00000100:00100000:2.0:1787583261.270752:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413820800 00000100:00100000:2.0:1787583261.270833:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:2.0:1787583261.270876:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+6:14909:x1874416413820800:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787583261.270981:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+6:14909:x1874416413820800:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 139us (375us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787583261.270989:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:1.0:1787583261.279138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583261.279690:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413820928 00000100:00100000:0.0:1787583261.279701:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413820928 00000100:00100000:0.0:1787583261.279758:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:0.0:1787583261.279769:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+6:14909:x1874416413820928:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787583261.279787:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583261.279802:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9092464f0400/0x19a47956376b7794 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c455f expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583261.279830:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9092464f0400/0x19a47956376b7794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c455f expref: 7 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583261.279841:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9092464f0400/0x19a47956376b7794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c455f expref: 7 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583261.280000:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9092464f0400, rc 0) 00000100:00100000:0.0:1787583261.280213:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+7:14909:x1874416413820928:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 444us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583261.280221:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:0.0:1787583261.283425:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583261.283585:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413821056 00000100:00100000:2.0:1787583261.283596:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413821056 00000100:00100000:2.0:1787583261.283661:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:2.0:1787583261.283672:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+7:14909:x1874416413821056:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787583261.283820:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+8:14909:x1874416413821056:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 149us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583261.283829:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:3.0:1787583261.290003:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583261.290217:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413821184 00000100:00100000:0.0:1787583261.290227:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413821184 00000100:00100000:0.0:1787583261.290333:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:0.0:1787583261.290357:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+8:14909:x1874416413821184:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787583261.290500:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+8:14909:x1874416413821184:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 145us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583261.290508:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:0.0:1787583261.295988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583261.296565:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413821312 00000100:00100000:3.0:1787583261.296576:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413821312 00000100:00100000:3.0:1787583261.296641:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:3.0:1787583261.296652:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+8:14928:x1874416413821312:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787583261.297141:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+8:14928:x1874416413821312:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 489us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583261.297150:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:1.0:1787583261.335123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583261.335331:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413821440 00000100:00100000:0.0:1787583261.335342:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413821440 00000100:00100000:0.0:1787583261.335413:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:0.0:1787583261.335425:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909344f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+8:14928:x1874416413821440:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787583261.335657:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909344f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+8:14928:x1874416413821440:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 234us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583261.335666:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:0.0:1787583261.360458:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583261.360619:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413821568 00000100:00100000:3.0:1787583261.360637:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413821568 00000100:00100000:3.0:1787583261.360709:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:3.0:1787583261.360720:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909344f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+8:14928:x1874416413821568:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787583261.360902:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909344f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+8:14928:x1874416413821568:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 183us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583261.360911:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:2.0:1787583261.364680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583261.365163:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413821696 00000100:00100000:0.0:1787583261.365173:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413821696 00000100:00100000:0.0:1787583261.365228:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:0.0:1787583261.365240:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909344f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+8:14909:x1874416413821696:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787583261.365256:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583261.365275:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9092464f0800/0x19a47956376b779b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4590 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583261.365369:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9092464f0800/0x19a47956376b779b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4590 expref: 9 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583261.365384:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9092464f0800/0x19a47956376b779b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4590 expref: 9 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583261.365421:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9092464f0800, rc 0) 00000100:00100000:0.0:1787583261.365487:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909344f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+9:14909:x1874416413821696:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 250us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583261.365495:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:1.0:1787583261.370477:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583261.370566:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413821824 00000100:00100000:2.0:1787583261.370576:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413821824 00000100:00100000:2.0:1787583261.370628:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:2.0:1787583261.370638:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909344f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+9:14909:x1874416413821824:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787583261.370662:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787583261.370684:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787583261.370688:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787583261.370691:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787583261.370694:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787583261.370697:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1787583261.372405:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909344f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+9:14909:x1874416413821824:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 1750us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583261.372417:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:3.0:1787583261.375222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583261.375322:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413821952 00000100:00100000:0.0:1787583261.375330:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413821952 00000100:00100000:0.0:1787583261.375383:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:0.0:1787583261.375404:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365c73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+9:14909:x1874416413821952:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787583261.375420:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583261.375436:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9092464f0a00/0x19a47956376b77a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4597 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583261.375462:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9092464f0a00/0x19a47956376b77a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4597 expref: 10 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583261.375472:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9092464f0a00/0x19a47956376b77a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4597 expref: 10 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583261.375481:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9092464f0a00, rc 0) 00000100:00100000:0.0:1787583261.375529:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365c73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+10:14909:x1874416413821952:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 138us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583261.375536:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:1.0:1787583261.377287:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583261.377418:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413822080 00000100:00100000:2.0:1787583261.377427:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413822080 00000100:00100000:2.0:1787583261.377471:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:2.0:1787583261.377481:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+10:14909:x1874416413822080:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787583261.377898:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+10:14909:x1874416413822080:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 133us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583261.377907:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:0.0:1787583261.383696:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583261.383835:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413822208 00000100:00100000:1.0:1787583261.383887:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413822208 00000100:00100000:1.0:1787583261.383941:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:1.0:1787583261.383951:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+10:14909:x1874416413822208:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787583261.384093:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+10:14909:x1874416413822208:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 142us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583261.384101:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:3.0:1787583261.387558:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583261.388110:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413822336 00000100:00100000:0.0:1787583261.388120:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413822336 00000100:00100000:0.0:1787583261.388177:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:0.0:1787583261.388202:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+10:14936:x1874416413822336:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787583261.388588:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+10:14936:x1874416413822336:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 388us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583261.388607:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:0.0:1787583261.398756:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583261.398816:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413822464 00000100:00100000:2.0:1787583261.398826:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413822464 00000100:00100000:2.0:1787583261.398912:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:2.0:1787583261.398923:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+10:14936:x1874416413822464:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787583261.399177:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+10:14936:x1874416413822464:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 255us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583261.399186:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:2.0:1787583261.416181:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583261.416280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583261.423939:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413822592 00000100:00100000:1.0:1787583261.423981:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413822592 00000100:00100000:1.0:1787583261.424017:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413822848 00000100:00100000:1.0:1787583261.424021:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413822848 00000100:00100000:1.0:1787583261.424054:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1787583261.424063:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1874416413822592:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787583261.424091:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77@192.168.203.11@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:1.0:1787583261.424141:0:17155:0:(genops.c:1385:class_connect()) connect: client 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77, cookie 0x19a47956376b77a9 00000004:00100000:1.0:1787583261.424163:0:17155:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787583261.424374:0:17155:0:(import.c:65:import_set_state_nolock()) ffff909246522000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787583261.424459:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:2403:x1874416413822592:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 394us (8287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583261.424466:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1787583261.424484:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:1.0:1787583261.424489:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1874416413822848:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787583261.424504:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77@192.168.203.11@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:1.0:1787583261.424542:0:17155:0:(genops.c:1385:class_connect()) connect: client 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77, cookie 0x19a47956376b77b0 00000004:00100000:1.0:1787583261.424555:0:17155:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787583261.426349:0:17155:0:(import.c:65:import_set_state_nolock()) ffff909246524000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787583261.426454:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:2403:x1874416413822848:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 1961us (10171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583261.426463:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:2.0:1787583261.434582:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583261.434653:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583261.436468:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413823104 00000100:00100000:1.0:1787583261.436468:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413822720 00000100:00100000:3.0:1787583261.436480:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413823104 00000100:00100000:1.0:1787583261.436480:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413822720 00000100:00080000:2.0:1787583261.436553:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787583261.436818:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1787583261.436830:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:0:x1874416413822720:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787583261.436891:0:17153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787583261.437004:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:0:x1874416413822720:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 177us (2350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583261.437012:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1787583261.437030:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1787583261.437037:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:14909:x1874416413823104:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787583261.437048:0:17153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787583261.437070:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:14909:x1874416413823104:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 34us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583261.437077:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1787583261.445110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583261.445216:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413822976 00000100:00100000:0.0:1787583261.445229:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413822976 00000100:00100000:0.0:1787583261.445409:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1787583261.445420:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:0:x1874416413822976:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787583261.445462:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787583261.445567:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:0:x1874416413822976:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 149us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583261.445574:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00080000:2.0:1787583261.446118:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787583261.454360:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583261.454483:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413823232 00000100:00100000:1.0:1787583261.454493:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413823232 00000100:00100000:1.0:1787583261.454582:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1787583261.454594:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:14909:x1874416413823232:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787583261.454687:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:14909:x1874416413823232:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 89us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583261.454696:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1787583261.467777:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583261.467836:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583261.471816:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413823360 00000100:00100000:3.0:1787583261.471830:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413823360 00000100:00100000:2.0:1787583261.472255:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413823488 00000100:00100000:2.0:1787583261.472261:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413823488 00000100:00100000:2.0:1787583261.472379:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1787583261.472388:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1874416413823488:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787583261.472438:0:18660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77@192.168.203.11@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:2.0:1787583261.472470:0:18660:0:(genops.c:1385:class_connect()) connect: client 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77, cookie 0x19a47956376b77b7 00002000:00100000:2.0:1787583261.472482:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77/ffff9092414f2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787583261.472500:0:18660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787583261.472673:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787583261.473156:0:18660:0:(import.c:65:import_set_state_nolock()) ffff9092414f4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787583261.473231:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:2403:x1874416413823488:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 842us (5395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583261.473251:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1787583261.473271:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1787583261.473277:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1874416413823360:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787583261.473294:0:18660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77@192.168.203.11@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:2.0:1787583261.473312:0:18660:0:(genops.c:1385:class_connect()) connect: client 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77, cookie 0x19a47956376b77be 00002000:00100000:2.0:1787583261.473319:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77/ffff9092414f5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787583261.473325:0:18660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787583261.473474:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787583261.473489:0:18660:0:(import.c:65:import_set_state_nolock()) ffff9092414f0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787583261.473512:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:2403:x1874416413823360:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 234us (5836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583261.473519:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1787583261.474552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583261.474687:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413823616 00000100:00100000:3.0:1787583261.474694:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413823616 00000100:00100000:3.0:1787583261.474731:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:3.0:1787583261.474739:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:14909:x1874416413823616:12345-192.168.203.11@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787583261.474785:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:14909:x1874416413823616:12345-192.168.203.11@tcp:900:mount.lustre.0 Request processed in 46us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583261.474792:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:0.0:1787583261.477472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583261.477794:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413823744 00000100:00100000:3.0:1787583261.477803:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413823744 00000100:00100000:3.0:1787583261.478409:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1787583261.478422:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:14909:x1874416413823744:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787583261.479178:0:17156:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 672us 00000004:00200000:0.0:1787583261.501621:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787583261.501766:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:14909:x1874416413823744:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 23343us (24297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583261.501780:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00010000:00010000:3.0:1787583261.518168:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583261.728659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583261.728763:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413823872 00000100:00100000:1.0:1787583261.728773:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413823872 00000100:00100000:1.0:1787583261.728836:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:1.0:1787583261.728903:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:14959:x1874416413823872:12345-192.168.203.11@tcp:101:mkdir.0 00010000:00010000:1.0:1787583261.728923:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583261.728948:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ba00/0x19a47956376b77c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c45c8 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583261.729434:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ac00/0x19a47956376b77cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583261.729451:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ac00/0x19a47956376b77cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583261.729467:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ac00/0x19a47956376b77cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787583261.733603:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787583261.733618:0:17155:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787583261.733678:0:17155:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ac00/0x19a47956376b77cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583261.733726:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ba00/0x19a47956376b77c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c45c8 expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583261.733747:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ac00/0x19a47956376b77cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c45c8 expref: 7 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583261.733756:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90934a205c00) 00010000:00010000:1.0:1787583261.733759:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787583261.733763:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924149ac00, rc 0) 00000100:00100000:1.0:1787583261.733837:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:14959:x1874416413823872:12345-192.168.203.11@tcp:101:mkdir.0 Request processed in 4991us (5188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583261.733891:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1787583262.158211:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fcead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435922688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583262.158283:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583262.158450:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435922688 00000100:00100000:0.0:1787583262.158458:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435922688 00000100:00100000:0.0:1787583262.158504:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787583262.158513:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435922688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787583262.158542:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787583262.158590:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435922688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583262.158611:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787583262.158723:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fcead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435922688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583262.159051:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787583262.162113:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435922816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583262.162494:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583262.162596:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435922816 00000100:00100000:0.0:1787583262.162604:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435922816 00000100:00100000:0.0:1787583262.162651:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787583262.162659:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435922816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787583262.162690:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787583262.162737:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435922816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583262.162743:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787583262.162869:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435922816:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787583262.544440:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583263.182284:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435922944:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.182313:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435923328:0@lo:400:kworker.0 00000100:00100000:3.0:1787583263.182462:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435923072:0@lo:400:kworker.0 00000100:00100000:0.0:1787583263.182499:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435923200:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.186563:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583263.186619:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435923840:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.186659:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583263.186680:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435924352:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.186714:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583263.186779:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435923328 00000100:00100000:2.0:1787583263.186793:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435923328 00000100:00100000:2.0:1787583263.186888:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435923840 00000100:00100000:2.0:1787583263.186903:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435923840 00000100:00100000:2.0:1787583263.186931:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787583263.186940:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3656:x1874416435923328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.186995:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3656:x1874416435923328:12345-0@lo:400:kworker.0 Request processed in 55us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.187002:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787583263.187018:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787583263.187024:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435923840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.187070:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435923840:12345-0@lo:400:kworker.0 Request processed in 46us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.187076:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787583263.187098:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787583263.187125:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435923328:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.187134:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435923840:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.187341:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435924352 00000100:00100000:2.0:1787583263.187345:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435924352 00000100:00080000:2.0:1787583263.187366:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787583263.187425:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787583263.187433:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435924352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.187494:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874416435924352:12345-0@lo:400:kworker.0 Request processed in 46us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.187501:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787583263.187553:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874416435924352:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.187618:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092484f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435924864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787583263.187646:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583263.187698:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435924864 00000100:00100000:2.0:1787583263.187702:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435924864 00000100:00100000:2.0:1787583263.187731:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787583263.187738:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435924864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787583263.187758:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787583263.187820:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435924864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.187827:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787583263.187872:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787583263.187893:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092484f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435924864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583263.189051:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583263.189119:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435923456:0@lo:400:kworker.0 00000100:00100000:1.0:1787583263.189161:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583263.189163:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435922944 00000100:00100000:2.0:1787583263.189170:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435922944 00000100:00100000:1.0:1787583263.189189:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435923968:0@lo:400:kworker.0 00000100:00100000:1.0:1787583263.189215:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583263.189221:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787583263.189229:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+24:3653:x1874416435922944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583263.189246:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435924480:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.189266:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+24:3653:x1874416435922944:12345-0@lo:400:kworker.0 Request processed in 38us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.189271:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787583263.189280:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583263.189313:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435922944:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.189328:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435923456 00000100:00100000:2.0:1787583263.189333:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435923456 00000100:00100000:1.0:1787583263.189344:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435923968 00000100:00100000:1.0:1787583263.189349:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435923968 00000100:00100000:2.0:1787583263.189361:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435924480 00000100:00100000:2.0:1787583263.189366:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435924480 00000100:00100000:1.0:1787583263.189376:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787583263.189397:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435923456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.189415:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787583263.189423:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435923968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583263.189444:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435923456:12345-0@lo:400:kworker.0 Request processed in 47us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583263.189453:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787583263.189457:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435923968:12345-0@lo:400:kworker.0 Request processed in 34us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.189464:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787583263.189479:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787583263.189489:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435923456:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.189492:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435924480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583263.189510:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435923968:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.189523:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435924480:12345-0@lo:400:kworker.0 Request processed in 32us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.189527:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787583263.189538:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc8aa00 x1874416435924480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787583263.189544:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787583263.189554:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435924480:0@lo:400:kworker.0 00000100:00100000:3.0:1787583263.191316:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583263.191373:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435923584:0@lo:400:kworker.0 00000100:00100000:0.0:1787583263.191390:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583263.191421:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583263.191429:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435923712:0@lo:400:kworker.0 00000100:00100000:0.0:1787583263.191458:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583263.191472:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435923072 00000100:00100000:3.0:1787583263.191478:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435923072 00000100:00100000:0.0:1787583263.191488:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435923200 00000100:00100000:0.0:1787583263.191493:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435923200 00000100:00100000:3.0:1787583263.191519:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435923584 00000100:00100000:3.0:1787583263.191524:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435923584 00000100:00100000:0.0:1787583263.191529:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435923712 00000100:00100000:0.0:1787583263.191534:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435923712 00000100:00100000:3.0:1787583263.191548:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787583263.191560:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435923072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583263.191570:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787583263.191579:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435923200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583263.191609:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435923072:12345-0@lo:400:kworker.0 Request processed in 52us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583263.191619:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787583263.191630:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435923200:12345-0@lo:400:kworker.0 Request processed in 46us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.191637:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787583263.191650:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787583263.191658:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787583263.191661:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435923584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583263.191670:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fcead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435923712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583263.191703:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435923584:12345-0@lo:400:kworker.0 Request processed in 45us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583263.191711:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787583263.191715:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fcead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435923712:12345-0@lo:400:kworker.0 Request processed in 46us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.191735:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787583263.191763:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583263.191764:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435923584:0@lo:400:kworker.0 00000100:00100000:0.0:1787583263.191786:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435923712:0@lo:400:kworker.0 00000100:00100000:3.0:1787583263.191787:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435924096:0@lo:400:kworker.0 00000100:00100000:0.0:1787583263.191802:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435924224:0@lo:400:kworker.0 00000100:00100000:3.0:1787583263.191825:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583263.191879:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435924096 00000100:00100000:3.0:1787583263.191883:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435924096 00000100:00100000:3.0:1787583263.191917:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787583263.191923:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435924096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583263.192000:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583263.192079:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435924224 00000100:00100000:1.0:1787583263.192084:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435924224 00000100:00100000:1.0:1787583263.192113:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787583263.192119:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435924224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583263.192894:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874416435924096:12345-0@lo:400:kworker.0 Request processed in 969us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583263.192902:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787583263.192927:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787583263.192933:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787583263.192968:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435924736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787583263.192979:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874416435924096:0@lo:400:kworker.0 00000100:00100000:3.0:1787583263.192989:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435924608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787583263.193002:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583263.193024:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583263.193140:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435924736 00000100:00100000:0.0:1787583263.193145:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435924736 00000100:00100000:3.0:1787583263.193223:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435924608 00000100:00100000:3.0:1787583263.193227:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435924608 00000100:00100000:0.0:1787583263.193239:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787583263.193250:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435924736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787583263.193274:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787583263.193307:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435924736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.193975:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435923072:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.194013:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435924736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583263.194034:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435923200:0@lo:400:kworker.0 00000100:00100000:0.0:1787583263.194540:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787583263.194561:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787583263.194571:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435924608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787583263.194585:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787583263.194965:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435924608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 395us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.194972:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787583263.195059:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435924608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583263.195373:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874416435924224:12345-0@lo:400:kworker.0 Request processed in 3251us (3370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583263.195410:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787583263.197459:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90937fc8b480 x1874416435924224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583263.197474:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874416435924224:0@lo:400:kworker.0 00000100:00100000:2.0:1787583263.564214:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583263.564316:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413824000 00000100:00100000:3.0:1787583263.564326:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413824000 00000100:00100000:3.0:1787583263.564416:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:3.0:1787583263.564426:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:15012:x1874416413824000:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:3.0:1787583263.564463:0:18681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787583263.564559:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:15012:x1874416413824000:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 135us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583263.564566:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00080000:0.0:1787583263.564865:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787583263.566232:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583263.567400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583263.567497:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413824128 00000100:00100000:2.0:1787583263.567506:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413824128 00000100:00100000:2.0:1787583263.567573:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:2.0:1787583263.567584:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:15012:x1874416413824128:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1787583263.567626:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1787583263.567862:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787583263.568033:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:15012:x1874416413824128:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 450us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.568041:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1787583263.570583:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583263.570762:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413824256 00000100:00100000:0.0:1787583263.570783:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413824256 00000100:00100000:0.0:1787583263.570870:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1787583263.570880:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:15012:x1874416413824256:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1787583263.570903:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787583263.570977:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:15012:x1874416413824256:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 99us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.570985:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00080000:3.0:1787583263.571045:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787583263.574115:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583263.574208:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413824384 00000100:00100000:0.0:1787583263.574217:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413824384 00000100:00100000:0.0:1787583263.574281:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1787583263.574291:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:15012:x1874416413824384:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1787583263.574315:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787583263.574420:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:15012:x1874416413824384:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 129us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.574427:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00080000:3.0:1787583263.574490:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1787583263.701180:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77 00000001:00080000:0.0:1787583263.701195:0:19474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00100000:3.0:1787583263.703485:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77 00000100:00100000:1.0:1787583263.745641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583263.745988:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413824512 00000100:00100000:0.0:1787583263.745999:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413824512 00000100:00100000:0.0:1787583263.746053:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:0.0:1787583263.746063:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+10:15044:x1874416413824512:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787583263.746080:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583263.746097:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9092464f1a00/0x19a47956376b77d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c45cf expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583263.746129:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9092464f1a00/0x19a47956376b77d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c45cf expref: 11 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583263.746161:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9092464f1a00/0x19a47956376b77d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c45cf expref: 11 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583263.746171:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9092464f1a00, rc 0) 00000100:00100000:0.0:1787583263.746237:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:15044:x1874416413824512:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 175us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.746245:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:1.0:1787583263.756080:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583263.757251:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413824640 00000100:00100000:2.0:1787583263.757263:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413824640 00000100:00100000:2.0:1787583263.757326:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:2.0:1787583263.757351:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:15044:x1874416413824640:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787583263.757511:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:15044:x1874416413824640:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 161us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.757519:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:3.0:1787583263.762924:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583263.763059:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413824768 00000100:00100000:2.0:1787583263.763069:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413824768 00000100:00100000:2.0:1787583263.763117:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:2.0:1787583263.763127:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:15044:x1874416413824768:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787583263.763262:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90934a21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:15044:x1874416413824768:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 136us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.763271:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:1.0:1787583263.766660:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583263.766759:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413824896 00000100:00100000:0.0:1787583263.766770:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413824896 00000100:00100000:0.0:1787583263.766826:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:0.0:1787583263.766841:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909355335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:15051:x1874416413824896:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787583263.767018:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909355335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:15051:x1874416413824896:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 183us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.767026:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:1.0:1787583263.784287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583263.784403:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413825024 00000100:00100000:0.0:1787583263.784413:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413825024 00000100:00100000:0.0:1787583263.784525:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:0.0:1787583263.784536:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909355335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:15051:x1874416413825024:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787583263.784710:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909355335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:15051:x1874416413825024:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 176us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.784718:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:3.0:1787583263.789222:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583263.793022:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413825152 00000100:00100000:0.0:1787583263.793037:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413825152 00000100:00100000:0.0:1787583263.793251:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:0.0:1787583263.793263:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:15051:x1874416413825152:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787583263.794077:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:15051:x1874416413825152:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 813us (4860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.794086:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:2.0:1787583263.797289:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583263.797829:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413825280 00000100:00100000:0.0:1787583263.797838:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413825280 00000100:00100000:0.0:1787583263.797977:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:0.0:1787583263.797987:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:15044:x1874416413825280:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787583263.798002:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583263.798017:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9092464f0e00/0x19a47956376b77da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4600 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583263.798042:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9092464f0e00/0x19a47956376b77da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4600 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583263.798052:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9092464f0e00/0x19a47956376b77da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4600 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583263.798060:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9092464f0e00, rc 0) 00000100:00100000:0.0:1787583263.798117:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+12:15044:x1874416413825280:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 125us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.798123:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:2.0:1787583263.802395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583263.802783:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413825408 00000100:00100000:1.0:1787583263.802793:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413825408 00000100:00100000:1.0:1787583263.802893:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:1.0:1787583263.802906:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+12:15044:x1874416413825408:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787583263.802945:0:17148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787583263.802979:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787583263.802984:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787583263.802987:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787583263.802990:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787583263.802992:0:17148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1787583263.805954:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+12:15044:x1874416413825408:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 2426us (2952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583263.805987:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:2.0:1787583263.810626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583263.810807:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413825536 00000100:00100000:0.0:1787583263.810817:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413825536 00000100:00100000:0.0:1787583263.811053:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:0.0:1787583263.811064:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+12:15044:x1874416413825536:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787583263.811081:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583263.811107:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9092464f1000/0x19a47956376b77e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4607 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583263.811132:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9092464f1000/0x19a47956376b77e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4607 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583263.811143:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9092464f1000/0x19a47956376b77e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4607 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583263.811152:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9092464f1000, rc 0) 00000100:00100000:0.0:1787583263.811205:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:15044:x1874416413825536:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 143us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.811211:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:2.0:1787583263.814836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583263.815086:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413825664 00000100:00100000:1.0:1787583263.815095:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413825664 00000100:00100000:1.0:1787583263.815148:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:1.0:1787583263.815159:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90935a924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:15044:x1874416413825664:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787583263.815296:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90935a924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:15044:x1874416413825664:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 139us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583263.815304:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:3.0:1787583263.819491:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583263.819580:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413825792 00000100:00100000:2.0:1787583263.819590:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413825792 00000100:00100000:2.0:1787583263.819655:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:2.0:1787583263.819666:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:15044:x1874416413825792:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787583263.819810:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:15044:x1874416413825792:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 145us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.819818:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:2.0:1787583263.823313:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583263.824492:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413825920 00000100:00100000:0.0:1787583263.824503:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413825920 00000100:00100000:0.0:1787583263.824587:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:0.0:1787583263.824599:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d914850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:15053:x1874416413825920:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787583263.824742:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d914850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:15053:x1874416413825920:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 145us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.824750:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:3.0:1787583263.835802:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583263.836045:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413826048 00000100:00100000:1.0:1787583263.836054:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413826048 00000100:00100000:1.0:1787583263.836100:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:1.0:1787583263.836110:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d915850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:15053:x1874416413826048:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787583263.836790:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d915850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:15053:x1874416413826048:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 678us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583263.836799:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:3.0:1787583263.850125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583263.850314:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583263.850469:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413826176 00000100:00100000:0.0:1787583263.850542:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413826176 00000100:00100000:0.0:1787583263.850637:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413826432 00000100:00100000:0.0:1787583263.850641:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413826432 00000100:00100000:1.0:1787583263.853886:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1787583263.853898:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1874416413826176:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787583263.853934:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d729bb3e-ce60-4d36-b85a-27ad79fddcea@192.168.203.11@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:1.0:1787583263.853976:0:17155:0:(genops.c:1385:class_connect()) connect: client d729bb3e-ce60-4d36-b85a-27ad79fddcea, cookie 0x19a47956376b77e8 00000004:00100000:1.0:1787583263.854003:0:17155:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787583263.854522:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1787583263.854530:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1874416413826432:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787583263.854561:0:18681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from d729bb3e-ce60-4d36-b85a-27ad79fddcea@192.168.203.11@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:2.0:1787583263.854583:0:18681:0:(genops.c:1385:class_connect()) connect: client d729bb3e-ce60-4d36-b85a-27ad79fddcea, cookie 0x19a47956376b77ef 00000100:00080000:1.0:1787583263.854712:0:17155:0:(import.c:65:import_set_state_nolock()) ffff90936616e800 : changing import state from RECOVER to FULL 00000004:00100000:2.0:1787583263.854744:0:18681:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787583263.854800:0:18681:0:(import.c:65:import_set_state_nolock()) ffff9092414f6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787583263.855567:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2403:x1874416413826432:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 1033us (5250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583263.855567:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2403:x1874416413826176:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 1666us (5447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.855577:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1787583263.858329:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583263.858380:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583263.858412:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583263.858436:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413826560 00000100:00100000:2.0:1787583263.858444:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413826560 00000100:00100000:3.0:1787583263.858518:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413826304 00000100:00100000:3.0:1787583263.858522:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413826304 00000100:00100000:0.0:1787583263.858646:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413826688 00000100:00100000:0.0:1787583263.858650:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413826688 00000100:00100000:1.0:1787583263.859230:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1787583263.859433:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1787583263.859446:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:0:x1874416413826560:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787583263.859481:0:18681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787583263.859551:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:0:x1874416413826560:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 109us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.859559:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00080000:2.0:1787583263.859581:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583263.859595:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787583263.864541:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1787583263.864556:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:3.0:1787583263.864566:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+7:0:x1874416413826304:12345-192.168.203.11@tcp:41:mount.lustre.0 00000100:00100000:0.0:1787583263.864573:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d729bb3e-ce60-4d36-b85a-27ad79fddcea+7:15044:x1874416413826688:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787583263.864607:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000004:00000024:0.0:1787583263.864616:0:17153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787583263.864935:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+7:0:x1874416413826304:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 380us (6569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583263.864944:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1787583263.864960:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:15044:x1874416413826688:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 392us (6544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.864968:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:2.0:1787583263.876332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583263.879582:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413826816 00000100:00100000:1.0:1787583263.879597:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413826816 00000100:00100000:1.0:1787583263.879699:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1787583263.879778:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:15044:x1874416413826816:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787583263.879985:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:15044:x1874416413826816:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 276us (3661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583263.879994:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1787583263.888446:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583263.888533:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583263.888579:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583263.888650:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413826944 00000100:00100000:2.0:1787583263.888660:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413826944 00000100:00100000:2.0:1787583263.888700:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413827072 00000100:00100000:2.0:1787583263.888702:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413827072 00000100:00100000:2.0:1787583263.888718:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1787583263.888725:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1874416413826944:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787583263.888759:0:18659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d729bb3e-ce60-4d36-b85a-27ad79fddcea@192.168.203.11@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:2.0:1787583263.888788:0:18659:0:(genops.c:1385:class_connect()) connect: client d729bb3e-ce60-4d36-b85a-27ad79fddcea, cookie 0x19a47956376b77f6 00002000:00100000:2.0:1787583263.888798:0:18659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d729bb3e-ce60-4d36-b85a-27ad79fddcea/ffff9092414f1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787583263.888809:0:18659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787583263.889103:0:18659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787583263.889132:0:18659:0:(import.c:65:import_set_state_nolock()) ffff9092414f6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787583263.889190:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2403:x1874416413826944:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 464us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.889198:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1787583263.889214:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1787583263.889219:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1874416413827072:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787583263.889234:0:18659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d729bb3e-ce60-4d36-b85a-27ad79fddcea@192.168.203.11@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:2.0:1787583263.889250:0:18659:0:(genops.c:1385:class_connect()) connect: client d729bb3e-ce60-4d36-b85a-27ad79fddcea, cookie 0x19a47956376b77fd 00002000:00100000:2.0:1787583263.889257:0:18659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d729bb3e-ce60-4d36-b85a-27ad79fddcea/ffff9092414f4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787583263.889263:0:18659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787583263.889302:0:18659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787583263.889318:0:18659:0:(import.c:65:import_set_state_nolock()) ffff90937e3c5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787583263.889340:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2403:x1874416413827072:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 119us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583263.889347:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1787583263.891053:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413827200 00000100:00100000:3.0:1787583263.891066:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413827200 00000100:00100000:3.0:1787583263.891117:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1787583263.891127:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:15044:x1874416413827200:12345-192.168.203.11@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787583263.891256:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:15044:x1874416413827200:12345-192.168.203.11@tcp:900:mount.lustre.0 Request processed in 130us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583263.891264:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1787583263.893782:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583263.894073:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413827328 00000100:00100000:0.0:1787583263.894081:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413827328 00000100:00100000:0.0:1787583263.894170:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:0.0:1787583263.894182:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:15044:x1874416413827328:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787583263.894260:0:17157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787583263.894335:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:15044:x1874416413827328:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 155us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583263.894343:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000040:00080000:2.0:1787583264.015083:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787583264.056976:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583264.057051:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413827456 00000100:00100000:3.0:1787583264.057061:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413827456 00000100:00100000:3.0:1787583264.057129:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1787583264.057150:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:15076:x1874416413827456:12345-192.168.203.11@tcp:101:mkdir.0 00010000:00010000:3.0:1787583264.057171:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583264.057193:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367ec00/0x19a47956376b7804 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4638 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583264.057253:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f200/0x19a47956376b780b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583264.057267:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f200/0x19a47956376b780b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583264.057280:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f200/0x19a47956376b780b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583264.057319:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787583264.057323:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787583264.057355:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f200/0x19a47956376b780b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583264.057396:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367ec00/0x19a47956376b7804 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4638 expref: 8 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583264.057414:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f200/0x19a47956376b780b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4638 expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583264.057423:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90934a205c00) 00010000:00010000:3.0:1787583264.057425:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787583264.057429:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367f200, rc 0) 00000100:00100000:3.0:1787583264.057502:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+7:15076:x1874416413827456:12345-192.168.203.11@tcp:101:mkdir.0 Request processed in 354us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583264.057517:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00010000:00010000:2.0:1787583264.590264:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583265.614323:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583266.254138:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787583266.254172:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435924992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787583266.254238:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583266.254338:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435924992 00000100:00100000:0.0:1787583266.254346:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435924992 00000100:00100000:0.0:1787583266.254553:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787583266.254563:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435924992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787583266.254591:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787583266.254643:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435924992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583266.254650:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787583266.254693:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435924992:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787583266.254805:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787583266.639548:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787583266.774399:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d729bb3e-ce60-4d36-b85a-27ad79fddcea 00000001:00100000:3.0:1787583266.774413:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77 00000001:00100000:2.0:1787583266.774602:0:17133:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d729bb3e-ce60-4d36-b85a-27ad79fddcea 00000001:00100000:2.0:1787583266.774619:0:17133:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77 00000001:02000400:2.0:1787583267.243394:0:20030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787583267.278660:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787583267.281310:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435925120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583267.282666:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435925248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583267.291660:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583267.291890:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435925248 00000100:00100000:0.0:1787583267.291899:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435925248 00000100:00100000:0.0:1787583267.291943:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787583267.291952:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435925248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787583267.292011:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787583267.292060:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435925248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583267.292067:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787583267.292972:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435925248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787583267.293879:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583267.294028:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435925120 00000100:00100000:3.0:1787583267.294035:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435925120 00000100:00100000:3.0:1787583267.294115:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787583267.294125:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435925120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787583267.294153:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787583267.294213:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435925120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583267.294219:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787583267.294284:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435925120:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787583267.662225:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787583268.047396:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787583268.307126:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435925376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583268.307205:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583268.307266:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435925376 00000100:00100000:1.0:1787583268.307274:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435925376 00000100:00100000:1.0:1787583268.307329:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787583268.307338:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435925376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787583268.307381:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787583268.307423:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435925376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583268.307430:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787583268.307451:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787583268.307479:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435925376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583268.307833:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435925504:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.307890:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583268.307915:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435926016:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.307939:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583268.307953:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435926528:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.307971:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583268.307988:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787583268.307993:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435925632:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.308011:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583268.308024:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435926144:0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.308210:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435925760:0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.308239:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583268.308259:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d83a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435926272:0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.308279:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583268.308296:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435926784:0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.308316:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583268.308330:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787583268.308351:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435925888:0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.308371:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583268.308384:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90936d839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435926400:0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.308399:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583268.308411:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435926912:0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.308429:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583268.308447:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435925760 00000100:00100000:0.0:1787583268.308450:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435925760 00000100:00100000:0.0:1787583268.308482:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435926272 00000100:00100000:0.0:1787583268.308485:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435926272 00000100:00100000:0.0:1787583268.308514:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435925888 00000100:00100000:0.0:1787583268.308517:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435925888 00000100:00100000:0.0:1787583268.308530:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787583268.308536:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435925760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.308576:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435925760:12345-0@lo:400:kworker.0 Request processed in 41us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583268.308582:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787583268.308595:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787583268.308600:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435926272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.308622:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435926272:12345-0@lo:400:kworker.0 Request processed in 23us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583268.308627:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787583268.308636:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787583268.308642:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435925888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.308961:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435925888:12345-0@lo:400:kworker.0 Request processed in 319us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583268.308968:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787583268.308989:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435926016 00000100:00100000:0.0:1787583268.308993:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435926016 00000100:00100000:0.0:1787583268.309009:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435926528 00000100:00100000:0.0:1787583268.309011:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435926528 00000100:00100000:0.0:1787583268.309021:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435926784 00000100:00100000:0.0:1787583268.309023:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435926784 00000100:00100000:0.0:1787583268.309031:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435926400 00000100:00100000:0.0:1787583268.309033:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435926400 00000100:00100000:0.0:1787583268.309042:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435926912 00000100:00100000:0.0:1787583268.309044:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435926912 00000100:00100000:0.0:1787583268.309070:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787583268.309076:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435926016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.309104:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874416435926016:12345-0@lo:400:kworker.0 Request processed in 29us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583268.309110:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787583268.309128:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787583268.309133:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435926528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.309161:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874416435926528:12345-0@lo:400:kworker.0 Request processed in 28us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583268.309167:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787583268.309178:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787583268.309183:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435926784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.309208:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874416435926784:12345-0@lo:400:kworker.0 Request processed in 25us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583268.309213:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787583268.309225:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787583268.309230:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435926400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.309252:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435926400:12345-0@lo:400:kworker.0 Request processed in 23us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583268.309257:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787583268.309267:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787583268.309271:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435926912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583268.309291:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435926912:12345-0@lo:400:kworker.0 Request processed in 20us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583268.309295:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787583268.309319:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787583268.309322:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787583268.309325:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787583268.309327:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583268.310358:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583268.310394:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909351692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435926656:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.310423:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583268.310458:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874416435926016:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.310471:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874416435926528:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.310505:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435925504 00000100:00100000:1.0:1787583268.310510:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435925504 00000100:00100000:1.0:1787583268.310543:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787583268.310551:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+24:3653:x1874416435925504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.310591:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+24:3653:x1874416435925504:12345-0@lo:400:kworker.0 Request processed in 40us (2700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583268.310598:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787583268.310627:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435926656 00000100:00100000:1.0:1787583268.310630:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435926656 00000100:00100000:1.0:1787583268.310655:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787583268.310661:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435926656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.310690:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435926656:12345-0@lo:400:kworker.0 Request processed in 30us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583268.310696:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787583268.310730:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909351692d80 x1874416435926656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583268.310740:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435926656:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.310749:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435925504:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.310789:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435925632 00000100:00100000:1.0:1787583268.310802:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435925632 00000100:00100000:1.0:1787583268.310828:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435926144 00000100:00100000:1.0:1787583268.310830:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435926144 00000100:00100000:1.0:1787583268.310842:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787583268.310867:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435925632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.310916:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435925632:12345-0@lo:400:kworker.0 Request processed in 50us (2903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583268.310921:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787583268.310934:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787583268.310939:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435926144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.310963:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435926144:12345-0@lo:400:kworker.0 Request processed in 24us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583268.310968:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787583268.310992:0:3655:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787583268.311002:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435925888:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.311012:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435926400:0@lo:400:kworker.0 00010000:00080000:1.0:1787583268.311023:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff909245b63100 x1874416435926912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583268.311030:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435926912:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.311040:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435925760:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.311049:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d83a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435926272:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.311058:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909351690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874416435926784:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.311088:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435925632:0@lo:400:kworker.0 00000100:00100000:1.0:1787583268.311106:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90936d838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435926144:0@lo:400:kworker.0 00000100:00080000:1.0:1787583268.311134:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787583268.311235:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435927040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583268.311259:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583268.311287:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435927040 00000100:00100000:1.0:1787583268.311291:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435927040 00000100:00100000:1.0:1787583268.311314:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787583268.311321:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435927040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787583268.311350:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787583268.311382:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435927040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583268.311389:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787583268.311419:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435927040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787583268.323452:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583268.323478:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435927168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787583268.323555:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583268.323946:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435927168 00000100:00100000:3.0:1787583268.323955:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435927168 00000100:00100000:3.0:1787583268.324003:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787583268.324013:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435927168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787583268.324045:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787583268.324095:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435927168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583268.324102:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787583268.324150:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435927168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787583268.686129:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583269.135291:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583269.135345:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583269.135380:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583269.135401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583269.135420:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583269.135439:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583269.135457:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583269.135474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583269.135498:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583269.135537:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413828096 00000100:00100000:2.0:1787583269.135547:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413828096 00000100:00100000:2.0:1787583269.135599:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413828608 00000100:00100000:2.0:1787583269.135603:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413828608 00000100:00100000:2.0:1787583269.135616:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413827968 00000100:00100000:2.0:1787583269.135619:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413827968 00000100:00100000:2.0:1787583269.135642:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413828480 00000100:00100000:2.0:1787583269.135645:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413828480 00000100:00100000:2.0:1787583269.135664:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:2.0:1787583269.135682:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2407:x1874416413828096:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583269.135749:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2407:x1874416413828096:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 69us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583269.135757:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:2.0:1787583269.135774:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1787583269.135781:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2407:x1874416413828608:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583269.135805:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2407:x1874416413828608:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583269.135811:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1787583269.135822:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1787583269.135829:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2407:x1874416413827968:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583269.135875:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2407:x1874416413827968:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 46us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583269.135881:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1787583269.135893:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:2.0:1787583269.135899:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2407:x1874416413828480:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583269.135921:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2407:x1874416413828480:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583269.135927:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:2.0:1787583269.135943:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413827840 00000100:00100000:2.0:1787583269.135946:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413827840 00000100:00100000:2.0:1787583269.135966:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413828352 00000100:00100000:2.0:1787583269.135968:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413828352 00000100:00100000:2.0:1787583269.135979:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413827712 00000100:00100000:2.0:1787583269.135987:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413827712 00000100:00100000:2.0:1787583269.136002:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413828224 00000100:00100000:2.0:1787583269.136005:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413828224 00000100:00100000:2.0:1787583269.136017:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:2.0:1787583269.136023:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2407:x1874416413827840:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583269.136065:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2407:x1874416413827840:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 42us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583269.136072:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:2.0:1787583269.136084:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:2.0:1787583269.136091:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d729bb3e-ce60-4d36-b85a-27ad79fddcea+5:2407:x1874416413828352:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583269.136114:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d729bb3e-ce60-4d36-b85a-27ad79fddcea+5:2407:x1874416413828352:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583269.136120:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:2.0:1787583269.136132:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1787583269.136137:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:2407:x1874416413827712:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583269.136159:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:2407:x1874416413827712:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583269.136165:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1787583269.136175:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:2.0:1787583269.136181:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092484f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2407:x1874416413828224:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1787583269.136203:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092484f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2407:x1874416413828224:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583269.136208:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00080000:2.0:1787583269.136236:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583269.136239:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583269.136248:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787583269.136250:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583269.141938:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413827584 00000100:00100000:0.0:1787583269.141953:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413827584 00000100:00100000:0.0:1787583269.142016:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:0.0:1787583269.142028:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d917450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:2407:x1874416413827584:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583269.142117:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d917450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:2407:x1874416413827584:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 92us (6835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583269.142126:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 144 00010000:00010000:2.0:1787583269.710988:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787583269.853813:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d729bb3e-ce60-4d36-b85a-27ad79fddcea 00000001:00100000:1.0:1787583269.857364:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d729bb3e-ce60-4d36-b85a-27ad79fddcea 00010000:00010000:3.0:1787583270.734768:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787583270.926704:0:20177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee10bf9d0 20000000:00000080:0.0:1787583270.926720:0:20177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9093661ec000 uarg=0000000000000000 20000000:01000000:0.0:1787583270.926757:0:20177:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787583270.926762:0:20177:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787583270.926766:0:20177:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787583270.927310:0:20178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787583270.927461:0:20177:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787583270.932111:0:20177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787583270.932139:0:20177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.932158:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909248496000/0x19a47956376b74a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b74a0 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.932168:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924713ea00/0x19a47956376b74b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b74ae expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.932176:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff909344dede00/0x19a47956376b74f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b74ed expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.932183:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90924713fa00/0x19a47956376b758e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7587 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.932219:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9092464f0a00/0x19a47956376b77a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4597 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.932227:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9092464f1000/0x19a47956376b77e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4607 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.932235:0:20177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.932272:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9092464f1000/0x19a47956376b77e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4607 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.932287:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9092464f1000/0x19a47956376b77e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4607 expref: 12 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583270.932302:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874416435927296:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583270.932411:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9092464f0a00/0x19a47956376b77a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4597 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.932419:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9092464f0a00/0x19a47956376b77a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4597 expref: 12 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583270.932428:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874416435927424:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583270.932470:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924713fa00/0x19a47956376b758e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b7587 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.932478:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90924713fa00/0x19a47956376b758e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b7587 expref: 23 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583270.932497:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874416435927552:0@lo:104: 00000100:00100000:0.0:1787583270.932532:0:20177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787583270.932572:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909344dede00/0x19a47956376b74f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b74ed expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.932582:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435927552 00010000:00010000:0.0:1787583270.932582:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff909344dede00/0x19a47956376b74f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b74ed expref: 23 pid: 17148 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.932592:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435927552 00000100:00100000:0.0:1787583270.932595:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874416435927680:0@lo:104: 00000100:00100000:0.0:1787583270.932626:0:20177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787583270.933271:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90924713ea00/0x19a47956376b74b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b74ae expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.933281:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90924713ea00/0x19a47956376b74b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b74ae expref: 23 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583270.933289:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874416435927808:0@lo:104: 00000100:00100000:0.0:1787583270.933310:0:20177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583270.934570:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435927680 00000100:00100000:1.0:1787583270.934578:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435927680 00000100:00100000:1.0:1787583270.934611:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435927808 00000100:00100000:1.0:1787583270.934613:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435927808 00000100:00100000:1.0:1787583270.934629:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787583270.934635:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff909248496000/0x19a47956376b74a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a47956376b74a0 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.934641:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+5:20177:x1874416435927552:12345-0@lo:104: 00010000:00010000:0.0:1787583270.934652:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff909248496000/0x19a47956376b74a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a47956376b74a0 expref: 23 pid: 17148 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.934656:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b758e expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583270.934667:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874416435927936:0@lo:104: 00000100:00100000:0.0:1787583270.934706:0:20177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583270.934720:0:20177:0:(client.c:2715:ptlrpc_set_wait()) set ffff909247060e40 going to sleep for 11 seconds 00010000:00010000:1.0:1787583270.934725:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787583270.934736:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+5:20177:x1874416435927552:12345-0@lo:104: Request processed in 98us (2203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583270.934741:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874416435927552:0@lo:104: 00000100:00100000:1.0:1787583270.934755:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787583270.934773:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435927936 00000100:00100000:1.0:1787583270.934776:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435927936 00000100:00100000:1.0:1787583270.934788:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787583270.934793:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+5:20177:x1874416435927680:12345-0@lo:104: 00010000:00010000:1.0:1787583270.934801:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b74f4 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.934861:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787583270.934867:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+5:20177:x1874416435927680:12345-0@lo:104: Request processed in 73us (2241us total) trans 0 rc 0/0 00010000:00010000:2.0:1787583270.934871:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1787583270.934875:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787583270.934881:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b758e expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.934890:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787583270.934892:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787583270.934898:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b758e expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.934899:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+4:20177:x1874416435927808:12345-0@lo:104: 00010000:00010000:1.0:1787583270.934911:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b74b5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.934929:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b758e expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787583270.934938:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b758e expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583270.934944:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787583270.934946:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787583270.934952:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+4:20177:x1874416435927808:12345-0@lo:104: Request processed in 55us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583270.934959:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787583270.934973:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787583270.934976:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874416435927680:0@lo:104: 00010000:00010000:2.0:1787583270.934978:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b758e expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.934984:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+3:20177:x1874416435927936:12345-0@lo:104: 00000100:00100000:0.0:1787583270.934992:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874416435927808:0@lo:104: 00010000:00010000:1.0:1787583270.934995:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b74a7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.935008:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787583270.935030:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b758e expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.935034:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1787583270.935038:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff90924713f800/0x19a47956376b7587 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b758e expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.935048:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea761437-c095-48a5-91f7-0c431111ca6a+3:20177:x1874416435927936:12345-0@lo:104: Request processed in 66us (342us total) trans 0 rc 0/0 00010000:00010000:2.0:1787583270.935057:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1787583270.935057:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787583270.935063:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b74f4 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.935090:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248497a00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787583270.935094:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b74f4 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.935102:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b74f4 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787583270.935107:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b74f4 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583270.935111:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787583270.935125:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b74f4 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.935130:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787583270.935137:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b74f4 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.935142:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909248497a00/0x19a47956376b74ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b74f4 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.935152:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787583270.935166:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b74b5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583270.935269:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435928064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583270.935296:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787583270.935307:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909248497200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787583270.935313:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b74b5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583270.935337:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787583270.935342:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b74b5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583270.935345:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435928192:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1787583270.935356:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b74b5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583270.935362:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787583270.935370:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787583270.935380:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b74b5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.935387:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787583270.935406:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874416435927936:0@lo:104: 00010000:00010000:2.0:1787583270.935409:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b74b5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.935417:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909248497200/0x19a47956376b74ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b74b5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.935426:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435928064 00010000:00010000:2.0:1787583270.935429:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787583270.935432:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435928064 00010000:00010000:2.0:1787583270.935434:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a47956376b74a7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.935441:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909247c53400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1787583270.935444:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a47956376b74a7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.935451:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a47956376b74a7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.935453:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924713fa00/0x19a47956376b758e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b7587 expref: 24 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787583270.935469:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a47956376b74a7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583270.935483:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787583270.935487:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435928192 00000100:00100000:1.0:1787583270.935491:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435928192 00010000:00010000:2.0:1787583270.935501:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b74a7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.935505:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909344dede00/0x19a47956376b74f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b74ed expref: 25 pid: 17148 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583270.935510:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1787583270.935518:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787583270.935524:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea761437-c095-48a5-91f7-0c431111ca6a+25:3655:x1874416435928064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787583270.935531:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b74a7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.935531:0:17140:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1787583270.935536:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787583270.935541:0:17140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1787583270.935547:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924713fa00/0x19a47956376b758e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b7587 expref: 25 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.935548:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff909247c53400/0x19a47956376b74a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a47956376b74a7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.935563:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea761437-c095-48a5-91f7-0c431111ca6a:3654:1874416435928448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787583270.935570:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924713fa00/0x19a47956376b758e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b7587 expref: 25 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583270.935576:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583270.935580:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787583270.935583:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787583270.935587:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713fa00/0x19a47956376b758e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b7587 expref: 25 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.935596:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787583270.935604:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583270.935613:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583270.935619:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea761437-c095-48a5-91f7-0c431111ca6a:3654:1874416435928320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583270.935636:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583270.935702:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea761437-c095-48a5-91f7-0c431111ca6a+24:3655:x1874416435928064:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583270.935710:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787583270.935726:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435928448 00000100:00100000:1.0:1787583270.935729:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435928320 00000100:00100000:0.0:1787583270.935731:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435928448 00000100:00100000:1.0:1787583270.935735:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435928320 00010000:00010000:0.0:1787583270.935748:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff909248496000/0x19a47956376b74a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b74a0 expref: 25 pid: 17148 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.935752:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90924713ea00/0x19a47956376b74b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b74ae expref: 25 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.935777:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787583270.935781:0:17139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787583270.935787:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea761437-c095-48a5-91f7-0c431111ca6a+25:3655:x1874416435928192:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787583270.935794:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787583270.935796:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583270.935803:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909344dede00/0x19a47956376b74f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b74ed expref: 25 pid: 17148 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583270.935804:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea761437-c095-48a5-91f7-0c431111ca6a+25:3654:x1874416435928320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787583270.935817:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583270.935825:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90924713ea00/0x19a47956376b74b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b74ae expref: 25 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.935832:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909344dede00/0x19a47956376b74f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b74ed expref: 25 pid: 17148 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.935934:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90924713ea00/0x19a47956376b74b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b74ae expref: 25 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.935949:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909344dede00/0x19a47956376b74f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b74ed expref: 25 pid: 17148 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.935956:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90924713ea00/0x19a47956376b74b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b74ae expref: 25 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.935961:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787583270.935971:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583270.935991:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea761437-c095-48a5-91f7-0c431111ca6a+23:3655:x1874416435928192:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583270.935999:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787583270.936016:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435928192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583270.936016:0:17140:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787583270.936018:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea761437-c095-48a5-91f7-0c431111ca6a+22:3654:x1874416435928320:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583270.936026:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787583270.936034:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787583270.936037:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea761437-c095-48a5-91f7-0c431111ca6a:3655:1874416435928064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787583270.936039:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea761437-c095-48a5-91f7-0c431111ca6a+22:3654:x1874416435928448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583270.936051:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583270.936057:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff909248496000/0x19a47956376b74a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a47956376b74a0 expref: 21 pid: 17148 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.936065:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff909248496000/0x19a47956376b74a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a47956376b74a0 expref: 21 pid: 17148 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583270.936070:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea761437-c095-48a5-91f7-0c431111ca6a:3654:1874416435928320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787583270.936080:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff909248496000/0x19a47956376b74a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a47956376b74a0 expref: 21 pid: 17148 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.936092:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583270.936119:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea761437-c095-48a5-91f7-0c431111ca6a+20:3654:x1874416435928448:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583270.936126:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787583270.936131:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea761437-c095-48a5-91f7-0c431111ca6a:3654:1874416435928448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787583270.936573:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583270.937521:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583270.937561:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583270.937603:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413828736 00000100:00100000:1.0:1787583270.937618:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413828736 00010000:00010000:1.0:1787583270.937641:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9092464f1000/0x19a47956376b77e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4607 expref: 13 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.937675:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413828864 00000100:00100000:1.0:1787583270.937679:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413828864 00010000:00010000:1.0:1787583270.937691:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9092464f0a00/0x19a47956376b77a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4597 expref: 14 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583270.937709:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874416435927296:192.168.203.11@tcp:104: 00000100:00100000:3.0:1787583270.937710:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1787583270.937725:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909343866850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9d5ba4b-a209-427f-bc83-827ad63e227c+14:2406:x1874416413828736:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583270.937736:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583270.937742:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9092464f1000/0x19a47956376b77e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4607 expref: 14 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.937755:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00010000:00010000:3.0:1787583270.937757:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9092464f1000/0x19a47956376b77e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4607 expref: 14 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.937767:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9d5ba4b-a209-427f-bc83-827ad63e227c+14:2407:x1874416413828864:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787583270.937775:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874416435927424:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583270.937777:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9092464f1000/0x19a47956376b77e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4607 expref: 14 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.937777:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583270.937787:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9092464f0a00/0x19a47956376b77a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4597 expref: 14 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583270.937795:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583270.937802:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9092464f0a00/0x19a47956376b77a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4597 expref: 13 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.937816:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9092464f0a00/0x19a47956376b77a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4597 expref: 13 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.937818:0:20177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583270.937841:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909343866850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9d5ba4b-a209-427f-bc83-827ad63e227c+12:2406:x1874416413828736:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 118us (321us total) trans 0 rc 0/0 00010000:00010000:1.0:1787583270.937867:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.937878:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.937891:0:17140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.937899:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.937911:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.937918:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.937923:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0200 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787583270.937928:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.937935:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.937954:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583270.937964:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583270.937983:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9d5ba4b-a209-427f-bc83-827ad63e227c+12:2407:x1874416413828864:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 220us (421us total) trans 0 rc 0/0 00010000:00010000:0.0:1787583270.938089:0:20177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.938103:0:20177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583270.938114:0:20177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9092464f0200/0x19a47956376b7812 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583270.940801:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:3.0:1787583270.940813:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1787583271.374504:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435928576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787583271.374573:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583271.374632:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435928576 00000100:00100000:3.0:1787583271.374639:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435928576 00000100:00100000:3.0:1787583271.374689:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787583271.374699:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435928576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787583271.374726:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787583271.374770:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435928576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583271.374785:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787583271.374836:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435928576:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787583271.376183:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787583271.758131:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583272.206926:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583272.206959:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413828992 00000100:00100000:1.0:1787583272.206969:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413828992 00000100:00100000:1.0:1787583272.207025:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:1.0:1787583272.207035:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d917c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+11:14923:x1874416413828992:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583272.207051:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787583272.207068:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90924149be00/0x19a47956376b7819 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c463f expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583272.207105:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90924149be00/0x19a47956376b7819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c463f expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583272.207116:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90924149be00/0x19a47956376b7819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c463f expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583272.207125:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924149be00, rc 0) 00000100:00100000:1.0:1787583272.207175:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d917c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+12:14923:x1874416413828992:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 141us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583272.207182:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:3.0:1787583272.213780:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583272.213837:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413829120 00000100:00100000:1.0:1787583272.213863:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413829120 00000100:00100000:1.0:1787583272.213915:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:1.0:1787583272.213931:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+12:14923:x1874416413829120:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583272.214072:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+12:14923:x1874416413829120:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 147us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583272.219983:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:3.0:1787583272.226111:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583272.226147:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413829248 00000100:00100000:3.0:1787583272.226156:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413829248 00000100:00100000:3.0:1787583272.226199:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:3.0:1787583272.226209:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+12:14923:x1874416413829248:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583272.226344:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+12:14923:x1874416413829248:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 134us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583272.226352:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:1.0:1787583272.234753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583272.234826:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413829376 00000100:00100000:2.0:1787583272.234836:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413829376 00000100:00100000:2.0:1787583272.234909:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:2.0:1787583272.234921:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d915c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+12:14923:x1874416413829376:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583272.234939:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583272.234956:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344dede00/0x19a47956376b7820 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4646 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.234995:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344dede00/0x19a47956376b7820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4646 expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.235006:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344dede00/0x19a47956376b7820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4646 expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.235015:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dede00, rc 0) 00000100:00100000:2.0:1787583272.235067:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d915c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:14923:x1874416413829376:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 148us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583272.235074:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:3.0:1787583272.258541:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583272.258573:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413829504 00000100:00100000:3.0:1787583272.258592:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413829504 00000100:00100000:3.0:1787583272.258636:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:3.0:1787583272.258646:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:14923:x1874416413829504:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583272.258915:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:14923:x1874416413829504:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 269us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583272.258923:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:3.0:1787583272.266334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583272.266371:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413829632 00000100:00100000:3.0:1787583272.266380:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413829632 00000100:00100000:3.0:1787583272.266424:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:3.0:1787583272.266433:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d915050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:14923:x1874416413829632:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583272.266594:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d915050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:14923:x1874416413829632:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 160us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583272.266603:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:2.0:1787583272.398151:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435928704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787583272.398238:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583272.398401:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435928704 00000100:00100000:1.0:1787583272.398409:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435928704 00000100:00100000:1.0:1787583272.398467:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787583272.398478:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435928704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787583272.398511:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787583272.398570:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435928704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583272.398594:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787583272.398734:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435928704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787583272.399035:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583272.399046:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435928832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787583272.399076:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583272.399150:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435928832 00000100:00100000:0.0:1787583272.399155:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435928832 00000100:00100000:0.0:1787583272.399189:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787583272.399196:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435928832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787583272.399215:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787583272.399263:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435928832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583272.399269:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787583272.399452:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435928832:0@lo:41:osp-pre-0-1.0 10000000:01000000:3.0:1787583272.718074:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787583272.718082:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90937fc57800 from 13 10000000:01000000:3.0:1787583272.718086:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787583272.718130:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b7827 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583272.718142:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b7827 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583272.718153:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b7827 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583272.718176:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435928960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787583272.718234:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583272.718276:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344b3d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787583272.718334:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435928960 00000100:00100000:2.0:1787583272.718342:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435928960 00000100:00100000:2.0:1787583272.718398:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787583272.718409:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+20:17151:x1874416435928960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583272.718421:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583272.718433:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344ded000/0x19a47956376b782e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b7827 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.718454:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344ded000/0x19a47956376b782e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b7827 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.718465:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344ded000/0x19a47956376b782e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7827 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.718474:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344ded000, rc 0) 00000100:00100000:2.0:1787583272.718538:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+21:17151:x1874416435928960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583272.718545:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787583272.718625:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435928960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787583272.718640:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b7827 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b782e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583272.718648:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b7827 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b782e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583272.718703:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787583272.718730:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583272.718755:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365c8ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787583272.718899:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435929088 00000100:00100000:3.0:1787583272.718904:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435929088 00000100:00100000:3.0:1787583272.718929:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787583272.718936:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d916450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+21:17151:x1874416435929088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583272.719028:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d916450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+21:17151:x1874416435929088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583272.719035:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787583272.719061:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583272.719084:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583272.719125:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583272.719137:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909343d630c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583272.719147:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435929216 00000100:00100000:3.0:1787583272.719151:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435929216 00000100:00100000:3.0:1787583272.719165:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787583272.719170:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+21:17151:x1874416435929216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787583272.719234:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+21:17151:x1874416435929216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583272.719241:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787583272.719280:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787583272.719926:0:20258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787583272.719974:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787583272.719989:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787583272.719996:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b7827 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b782e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583272.720006:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90936367ec00/0x19a47956376b7827 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b782e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787583272.720016:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787583272.720019:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff909365f3c000 from 13 10000000:01000000:3.0:1787583272.720022:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787583272.720042:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ea00/0x19a47956376b7835 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583272.720050:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff90936367ea00/0x19a47956376b7835 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583272.720058:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff90936367ea00/0x19a47956376b7835 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583272.720081:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787583272.720111:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583272.720124:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909343d63600 going to sleep for 11 seconds 00000100:00100000:3.0:1787583272.720137:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435929344 00000100:00100000:3.0:1787583272.720141:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435929344 00000100:00100000:3.0:1787583272.720161:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787583272.720168:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+21:17151:x1874416435929344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787583272.720176:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583272.720185:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90936367f000/0x19a47956376b783c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b7835 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583272.720201:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90936367f000/0x19a47956376b783c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b7835 expref: 22 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583272.720210:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90936367f000/0x19a47956376b783c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7835 expref: 22 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583272.720218:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367f000, rc 0) 00000100:00100000:3.0:1787583272.720246:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+22:17151:x1874416435929344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583272.720252:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787583272.720281:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787583272.720292:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff90936367ea00/0x19a47956376b7835 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b783c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583272.721447:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff90936367ea00/0x19a47956376b7835 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b783c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583272.721526:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787583272.721563:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583272.721590:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909343d63600 going to sleep for 11 seconds 00000100:00100000:2.0:1787583272.723009:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435929472 00000100:00100000:2.0:1787583272.723019:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435929472 00000100:00100000:2.0:1787583272.723072:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787583272.723082:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+22:17151:x1874416435929472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787583272.723225:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+22:17151:x1874416435929472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583272.723234:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787583272.723281:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787583272.723336:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787583272.723381:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583272.723405:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f227780 going to sleep for 11 seconds 00000100:00100000:2.0:1787583272.723419:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435929600 00000100:00100000:2.0:1787583272.723422:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435929600 00000100:00100000:2.0:1787583272.723444:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787583272.723449:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+22:17151:x1874416435929600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787583272.723528:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+22:17151:x1874416435929600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583272.723534:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787583272.723574:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787583272.724257:0:20259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787583272.724321:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787583272.724341:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787583272.724356:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff90936367ea00/0x19a47956376b7835 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b783c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.724366:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff90936367ea00/0x19a47956376b7835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b783c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583272.724375:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787583272.724377:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90935822f800 from 13 10000000:01000000:2.0:1787583272.724380:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787583272.724402:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b7843 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.724410:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b7843 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.724418:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b7843 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583272.724432:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787583272.724462:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583272.724478:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344d43180 going to sleep for 11 seconds 00000100:00100000:2.0:1787583272.724492:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435929728 00000100:00100000:2.0:1787583272.724495:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435929728 00000100:00100000:2.0:1787583272.724519:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787583272.724526:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+22:17151:x1874416435929728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583272.724535:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583272.724545:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff909344dec400/0x19a47956376b784a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b7843 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.724564:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff909344dec400/0x19a47956376b784a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b7843 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.724583:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff909344dec400/0x19a47956376b784a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7843 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.724591:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dec400, rc 0) 00000100:00100000:2.0:1787583272.724623:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:17151:x1874416435929728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583272.724628:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787583272.724659:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787583272.724671:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b7843 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b784a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.724679:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b7843 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b784a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583272.724715:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787583272.724738:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583272.724752:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344d43180 going to sleep for 11 seconds 00000100:00100000:2.0:1787583272.724764:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435929856 00000100:00100000:2.0:1787583272.724766:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435929856 00000100:00100000:2.0:1787583272.724785:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787583272.724791:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:17151:x1874416435929856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787583272.724878:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:17151:x1874416435929856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583272.724884:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787583272.724913:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787583272.724945:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787583272.724980:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583272.724993:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909246498e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787583272.725004:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435929984 00000100:00100000:2.0:1787583272.725007:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435929984 00000100:00100000:2.0:1787583272.725028:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787583272.725033:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:17151:x1874416435929984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787583272.725095:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:17151:x1874416435929984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583272.725101:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787583272.725138:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435929984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787583272.730538:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787583272.732682:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787583272.732718:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787583272.732730:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b7843 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b784a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.732743:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344deda00/0x19a47956376b7843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b784a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787583272.732754:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787583272.732757:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff909248438000 from 13 10000000:01000000:2.0:1787583272.732761:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787583272.732796:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b7851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.732804:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b7851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583272.732830:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b7851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583272.732873:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435930112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787583272.732941:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583272.732992:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936ef41180 going to sleep for 11 seconds 00000100:00100000:0.0:1787583272.733103:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435930112 00000100:00100000:0.0:1787583272.733111:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435930112 00000100:00100000:0.0:1787583272.733162:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787583272.733175:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+23:17151:x1874416435930112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787583272.733188:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583272.733200:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9092464f1800/0x19a47956376b7858 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a47956376b7851 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583272.733221:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9092464f1800/0x19a47956376b7858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a47956376b7851 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583272.733231:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9092464f1800/0x19a47956376b7858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a47956376b7851 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583272.733239:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9092464f1800, rc 0) 00000100:00100000:0.0:1787583272.733291:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+24:17151:x1874416435930112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583272.733307:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787583272.733388:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435930112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787583272.733402:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b7851 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7858 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583272.733409:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b7851 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a47956376b7858 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583272.733464:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435930240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787583272.733494:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583272.733520:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936687af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787583272.733559:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435930240 00000100:00100000:0.0:1787583272.733563:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435930240 00000100:00100000:0.0:1787583272.733623:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787583272.733631:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+24:17151:x1874416435930240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787583272.733731:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea761437-c095-48a5-91f7-0c431111ca6a+24:17151:x1874416435930240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583272.733739:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787583272.735959:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435930240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787583272.736023:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435930368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787583272.736105:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583272.736332:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff909365c8ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787583272.739943:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435930368 00000100:00100000:1.0:1787583272.739960:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435930368 00000100:00100000:1.0:1787583272.740029:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787583272.740040:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+24:17151:x1874416435930368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787583272.740219:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+24:17151:x1874416435930368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (4112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583272.740227:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787583272.740341:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea761437-c095-48a5-91f7-0c431111ca6a:17151:1874416435930368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787583272.741137:0:20261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787583272.741550:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787583272.741574:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787583272.741584:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b7851 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7858 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583272.741602:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff909344decc00/0x19a47956376b7851 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a47956376b7858 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583272.782620:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787583273.422013:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787583273.422036:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435930496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787583273.422115:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583273.422288:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435930496 00000100:00100000:3.0:1787583273.422296:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435930496 00000100:00100000:3.0:1787583273.422376:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787583273.422387:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435930496:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787583273.422410:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909245b61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435930624:0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787583273.422416:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787583273.422444:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583273.422470:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787583273.422476:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435930496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583273.422478:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435930752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583273.422489:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787583273.422506:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435930624 00000100:00100000:1.0:1787583273.422507:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583273.422511:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435930624 00000100:00100000:3.0:1787583273.422529:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435930752 00000100:00100000:3.0:1787583273.422532:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435930752 00000100:00100000:3.0:1787583273.422546:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787583273.422551:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435930624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787583273.422561:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787583273.422600:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435930624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583273.422606:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787583273.422616:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787583273.422622:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435930752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787583273.422651:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787583273.422661:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909245b61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435930624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787583273.422686:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435930752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583273.422689:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90937fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435930752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583273.422708:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787583273.422769:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787583273.422773:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583273.423103:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435930880:0@lo:400:kworker.0 00000100:00100000:0.0:1787583273.423132:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583273.423145:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435931264:0@lo:400:kworker.0 00000100:00100000:0.0:1787583273.423170:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435931392:0@lo:400:kworker.0 00000100:00100000:2.0:1787583273.423186:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583273.423200:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583273.423217:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435931776:0@lo:400:kworker.0 00000100:00100000:0.0:1787583273.423224:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435931904:0@lo:400:kworker.0 00000100:00100000:2.0:1787583273.423254:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583273.423271:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435931264 00000100:00100000:0.0:1787583273.423276:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435931264 00000100:00100000:2.0:1787583273.423285:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787583273.423294:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435931136:0@lo:400:kworker.0 00000100:00100000:0.0:1787583273.423320:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787583273.423329:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583273.423331:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435931264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583273.423352:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435931648:0@lo:400:kworker.0 00000100:00100000:0.0:1787583273.423374:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435931264:12345-0@lo:400:kworker.0 Request processed in 45us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583273.423381:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787583273.423386:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583273.423408:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583273.423418:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435931264:0@lo:400:kworker.0 00000100:00100000:0.0:1787583273.423444:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435930496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787583273.423448:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435931392 00000100:00100000:2.0:1787583273.423453:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435931392 00000100:00100000:0.0:1787583273.423459:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787583273.423466:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435931008:0@lo:400:kworker.0 00000100:00100000:0.0:1787583273.423489:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583273.423493:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787583273.423502:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435931392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583273.423510:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435931520:0@lo:400:kworker.0 00000100:00100000:2.0:1787583273.423542:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435931392:12345-0@lo:400:kworker.0 Request processed in 41us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583273.423553:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787583273.423554:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583273.423566:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435932032:0@lo:400:kworker.0 00000100:00100000:0.0:1787583273.423591:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583273.423597:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435931776 00000100:00100000:2.0:1787583273.423602:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435931776 00000100:00100000:0.0:1787583273.423610:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435931392:0@lo:400:kworker.0 00000100:00100000:2.0:1787583273.423622:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435931136 00000100:00100000:2.0:1787583273.423626:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435931136 00000100:00100000:2.0:1787583273.423640:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435931648 00000100:00100000:2.0:1787583273.423642:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435931648 00000100:00100000:0.0:1787583273.423655:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435931904 00000100:00100000:2.0:1787583273.423657:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435931520 00000100:00100000:0.0:1787583273.423661:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435931904 00000100:00100000:2.0:1787583273.423662:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435931520 00000100:00100000:0.0:1787583273.423688:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435932032 00000100:00100000:0.0:1787583273.423692:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435932032 00000100:00100000:0.0:1787583273.423705:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787583273.423712:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435931776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583273.423745:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874416435931776:12345-0@lo:400:kworker.0 Request processed in 34us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583273.423752:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787583273.423763:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787583273.423827:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435930880 00000100:00100000:1.0:1787583273.423831:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435930880 00000100:00100000:1.0:1787583273.423886:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787583273.423893:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+24:3653:x1874416435930880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583273.423927:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea761437-c095-48a5-91f7-0c431111ca6a+24:3653:x1874416435930880:12345-0@lo:400:kworker.0 Request processed in 35us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583273.423933:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787583273.423967:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435931008 00000100:00100000:1.0:1787583273.423970:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435931008 00000100:00100000:1.0:1787583273.423996:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787583273.423999:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787583273.424005:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435931008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583273.424032:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435931008:12345-0@lo:400:kworker.0 Request processed in 30us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583273.424048:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787583273.424067:0:18681:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787583273.424074:0:18681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787583273.424075:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787583273.424084:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787583273.424091:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435931904:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787583273.424117:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c6a00 x1874416435931776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583273.424126:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435931904:12345-0@lo:400:kworker.0 Request processed in 34us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583273.424134:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874416435931776:0@lo:400:kworker.0 00000100:00100000:1.0:1787583273.424135:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787583273.424151:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787583273.424158:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787583273.424165:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435932032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583273.424189:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435931008:0@lo:400:kworker.0 00000100:00100000:1.0:1787583273.424195:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874416435932032:12345-0@lo:400:kworker.0 Request processed in 29us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583273.424201:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787583273.424205:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9092473c6680 x1874416435932032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583273.424211:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787583273.424215:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874416435932032:0@lo:400:kworker.0 00000100:00100000:1.0:1787583273.424220:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787583273.424229:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435931520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583273.424230:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea761437-c095-48a5-91f7-0c431111ca6a:3653:1874416435930880:0@lo:400:kworker.0 00000100:00100000:2.0:1787583273.424248:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435931904:0@lo:400:kworker.0 00000100:00100000:1.0:1787583273.424262:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874416435931520:12345-0@lo:400:kworker.0 Request processed in 34us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583273.424269:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787583273.424272:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874416435931520:0@lo:400:kworker.0 00000100:00080000:2.0:1787583273.424298:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583273.424302:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583273.424313:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787583273.424458:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435931136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787583273.424692:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874416435931136:12345-0@lo:400:kworker.0 Request processed in 922us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583273.424699:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787583273.424730:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874416435931136:0@lo:400:kworker.0 00000100:00100000:3.0:1787583273.425672:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435931648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583273.425990:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435931648:12345-0@lo:400:kworker.0 Request processed in 1982us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583273.425999:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787583273.426157:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435931648:0@lo:400:kworker.0 00010000:00010000:3.0:1787583273.807351:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583274.254982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583274.255020:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583274.255065:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583274.255089:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583274.255108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583274.255125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583274.255145:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583274.255182:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583274.255219:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583274.255541:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413829760 00000100:00100000:0.0:1787583274.255551:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413829760 00000100:00100000:0.0:1787583274.255599:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:0.0:1787583274.255610:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092458a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:2406:x1874416413829760:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583274.255688:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092458a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d5ba4b-a209-427f-bc83-827ad63e227c+13:2406:x1874416413829760:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 80us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.255696:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:0.0:1787583274.255735:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413830272 00000100:00100000:0.0:1787583274.255739:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413830272 00000100:00100000:0.0:1787583274.255767:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413830784 00000100:00100000:0.0:1787583274.255770:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413830784 00000100:00100000:0.0:1787583274.255782:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413830144 00000100:00100000:0.0:1787583274.255785:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413830144 00000100:00100000:0.0:1787583274.255795:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413830656 00000100:00100000:0.0:1787583274.255798:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413830656 00000100:00100000:0.0:1787583274.255811:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1787583274.255817:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2406:x1874416413830272:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583274.255869:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2406:x1874416413830272:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 52us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.255875:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1787583274.255887:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1787583274.255894:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d729bb3e-ce60-4d36-b85a-27ad79fddcea+5:2406:x1874416413830784:12345-192.168.203.11@tcp:400:kworker.0 00000040:00080000:3.0:1787583274.256235:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787583274.256449:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1787583274.256459:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2406:x1874416413830144:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583274.256492:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2406:x1874416413830144:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583274.256499:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1787583274.256512:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1787583274.256517:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d729bb3e-ce60-4d36-b85a-27ad79fddcea+5:2406:x1874416413830656:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583274.256535:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d729bb3e-ce60-4d36-b85a-27ad79fddcea+5:2406:x1874416413830656:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 18us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583274.256541:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1787583274.256555:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413830016 00000100:00100000:3.0:1787583274.256558:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413830016 00000100:00100000:3.0:1787583274.256581:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413830528 00000100:00100000:3.0:1787583274.256583:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413830528 00000100:00100000:3.0:1787583274.256602:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413829888 00000100:00100000:3.0:1787583274.256605:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413829888 00000100:00100000:0.0:1787583274.256720:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d729bb3e-ce60-4d36-b85a-27ad79fddcea+5:2406:x1874416413830784:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.256727:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1787583274.256811:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413830400 00000100:00100000:0.0:1787583274.256815:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413830400 00000100:00100000:0.0:1787583274.257745:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:0.0:1787583274.257761:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2406:x1874416413830016:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583274.257807:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2406:x1874416413830016:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 52us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.257814:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:0.0:1787583274.258546:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:0.0:1787583274.258559:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+5:2406:x1874416413830528:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583274.258611:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+5:2406:x1874416413830528:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 56us (3521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.258618:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:0.0:1787583274.258633:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1787583274.258640:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2406:x1874416413830400:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1787583274.258663:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2406:x1874416413830400:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (3480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.258669:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00080000:2.0:1787583274.258809:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583274.258814:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787583274.258817:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787583274.258820:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787583274.263779:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:3.0:1787583274.263803:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:2406:x1874416413829888:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1787583274.263924:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:2406:x1874416413829888:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 124us (8797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583274.263932:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00080000:2.0:1787583274.265176:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787583274.292816:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583274.292998:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413830912 00000100:00100000:0.0:1787583274.293009:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413830912 00000100:00100000:0.0:1787583274.293087:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:0.0:1787583274.293098:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:15592:x1874416413830912:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787583274.293116:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583274.293137:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1200/0x19a47956376b785f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c464d expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293198:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b7866 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293211:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b7866 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293224:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b7866 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293237:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b786d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293261:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b786d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293268:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b786d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293356:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1600/0x19a47956376b7874 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293365:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1600/0x19a47956376b7874 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293372:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1600/0x19a47956376b7874 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583274.293401:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787583274.293405:0:17155:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583274.293442:0:17155:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1600/0x19a47956376b7874 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293453:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b7866 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293459:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b7866 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293466:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b7866 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293471:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583274.293476:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b7866 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293489:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b7866 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293502:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90934a205c00) 00010000:00010000:0.0:1787583274.293505:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583274.293509:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b7866 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293514:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b7866 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293528:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b786d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293533:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b786d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293538:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b786d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293544:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583274.293546:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b786d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293552:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b786d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293559:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90936a1c3200) 00010000:00010000:0.0:1787583274.293561:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583274.293564:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b786d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293579:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b786d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293610:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1200/0x19a47956376b785f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c464d expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293621:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1600/0x19a47956376b7874 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c464d expref: 7 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.293628:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90936a1c3e00) 00010000:00010000:0.0:1787583274.293630:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583274.293632:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9092464f1600, rc 0) 00000100:00100000:0.0:1787583274.293840:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:15592:x1874416413830912:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 742us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.293891:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:1.0:1787583274.301156:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583274.301286:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413831040 00000100:00100000:0.0:1787583274.301296:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413831040 00000100:00100000:0.0:1787583274.301364:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:0.0:1787583274.301376:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909245b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:15592:x1874416413831040:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787583274.301458:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909245b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:15592:x1874416413831040:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 Request processed in 85us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.301467:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1787583274.305176:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.305269:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413831296 00000100:00100000:2.0:1787583274.305280:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413831296 00000100:00100000:2.0:1787583274.305351:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1787583274.305361:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:15592:x1874416413831296:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583274.305379:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583274.305399:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b787b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4654 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.305470:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b7882 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.305484:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b7882 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.305496:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b7882 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.305510:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7889 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.305517:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7889 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.305523:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7889 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.305626:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded200/0x19a47956376b7890 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.305635:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded200/0x19a47956376b7890 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.305660:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded200/0x19a47956376b7890 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583274.305670:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787583274.305813:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b7882 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.305820:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b7882 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.305827:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b7882 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.305833:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344ded800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583274.305836:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b7882 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.306012:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b7882 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.306028:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90936a1c3e00) 00010000:00010000:2.0:1787583274.306031:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583274.306036:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b7882 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.306041:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b7882 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.306054:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7889 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.306059:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7889 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.306072:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7889 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.306077:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583274.306081:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7889 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.306088:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7889 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.306096:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff909345181100) 00010000:00010000:2.0:1787583274.306099:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583274.306102:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7889 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.306108:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7889 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.315103:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b787b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4654 expref: 10 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.315134:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded200/0x19a47956376b7890 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4654 expref: 9 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.315145:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff909345181c00) 00010000:00010000:2.0:1787583274.315147:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583274.315151:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344ded200, rc 0) 00000100:00100000:2.0:1787583274.315224:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+9:15592:x1874416413831296:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 9864us (10056us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787583274.315245:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:1.0:1787583274.318681:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583274.319342:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413831424 00000100:00100000:0.0:1787583274.319352:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413831424 00000100:00100000:0.0:1787583274.319410:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1787583274.319420:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+9:15592:x1874416413831424:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787583274.319569:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+9:15592:x1874416413831424:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 150us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.319577:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:1.0:1787583274.325417:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583274.325502:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413831552 00000100:00100000:0.0:1787583274.325511:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413831552 00000100:00100000:0.0:1787583274.325571:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1787583274.325581:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909348840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:15592:x1874416413831552:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1787583274.327220:0:17155:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1588us 00000100:00100000:0.0:1787583274.347502:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909348840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:15592:x1874416413831552:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 21912us (22084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.347516:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:1.0:1787583274.351402:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.351497:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413831680 00000100:00100000:2.0:1787583274.351507:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413831680 00000100:00100000:2.0:1787583274.351601:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:2.0:1787583274.351612:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+9:15598:x1874416413831680:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583274.351633:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583274.351652:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b789e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c465b expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351723:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351738:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351749:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351764:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351773:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351780:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351823:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351933:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351940:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351946:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344ded800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583274.351951:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351959:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351972:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90934a205c00) 00010000:00010000:2.0:1787583274.351974:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583274.351979:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351985:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.351997:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.352004:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.352010:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.352014:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583274.352024:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.352030:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.352037:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff909345181100) 00010000:00010000:2.0:1787583274.352040:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583274.352042:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.352048:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.352081:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b789e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c465b expref: 10 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.352091:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90934a205c00) 00010000:00010000:2.0:1787583274.352094:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583274.352098:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b789e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c465b expref: 10 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.352107:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dec200, rc 0) 00000100:00100000:2.0:1787583274.352168:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+9:15598:x1874416413831680:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 557us (772us total) trans 0 rc 301/301 00000100:00100000:2.0:1787583274.352175:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:2.0:1787583274.359049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583274.359357:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413831808 00000100:00100000:3.0:1787583274.359367:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413831808 00000100:00100000:3.0:1787583274.359426:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1787583274.359437:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+9:15598:x1874416413831808:12345-192.168.203.11@tcp:700:lfs.0 00000100:00100000:3.0:1787583274.359530:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+9:15598:x1874416413831808:12345-192.168.203.11@tcp:700:lfs.0 Request processed in 94us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583274.359538:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:1.0:1787583274.362081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.363499:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413832064 00000100:00100000:2.0:1787583274.363512:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413832064 00000100:00100000:2.0:1787583274.363583:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:2.0:1787583274.363616:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+9:15598:x1874416413832064:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:2.0:1787583274.363671:0:20292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583274.363696:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ac00/0x19a47956376b77cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c45c8 expref: 9 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.363716:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90934a205c00) 00010000:00010000:2.0:1787583274.363720:0:20292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583274.363774:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.363787:0:20292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f200/0x19a47956376b780b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4638 expref: 5 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.363795:0:20292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.363831:0:20292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f200/0x19a47956376b780b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4638 expref: 5 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.363885:0:20292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f200/0x19a47956376b780b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4638 expref: 5 pid: 17154 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583274.363899:0:20292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20292:1874416435932160:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583274.363994:0:20292:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936ef41f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787583274.366554:0:20292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20292:1874416435932160:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583274.366580:0:20292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583274.370936:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.371564:0:20179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413832192 00000100:00100000:2.0:1787583274.371574:0:20179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413832192 00010000:00010000:2.0:1787583274.371628:0:20179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f200/0x19a47956376b780b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4638 expref: 6 pid: 17154 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583274.371663:0:20179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:2.0:1787583274.371673:0:20179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:2406:x1874416413832192:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787583274.371687:0:20179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583274.371693:0:20179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f200/0x19a47956376b780b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4638 expref: 6 pid: 17154 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.371707:0:20179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f200/0x19a47956376b780b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4638 expref: 6 pid: 17154 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.371728:0:20179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f200/0x19a47956376b780b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4638 expref: 6 pid: 17154 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.371745:0:20179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90934a205c00) 00010000:00010000:2.0:1787583274.371751:0:20179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.371761:0:20179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.371768:0:20179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.371795:0:20179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583274.371912:0:20179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d729bb3e-ce60-4d36-b85a-27ad79fddcea+5:2406:x1874416413832192:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 239us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583274.371920:0:20179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00010000:00010000:0.0:1787583274.372631:0:20292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.372642:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.372665:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b78ba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.372675:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b78ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.372684:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b78ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374587:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ae00/0x19a47956376b78c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374615:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ae00/0x19a47956376b78c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374625:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ae00/0x19a47956376b78c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583274.374648:0:20292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024f0fdff reply state 000000001ba68695 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ae00/0x19a47956376b78c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374659:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ae00/0x19a47956376b78c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374665:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90936a0aef00) 00010000:00010000:1.0:1787583274.374668:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787583274.374671:0:20292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787583274.374676:0:20292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787583274.374684:0:20292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374701:0:20292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374708:0:20292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374714:0:20292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583274.374718:0:20292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374726:0:20292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374736:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90934a205c00) 00010000:00010000:1.0:1787583274.374739:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787583274.374742:0:20292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374748:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78b3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787583274.374765:0:20292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024f0fdff reply state 000000001ba68695 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b78ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374773:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b78ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.374779:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90936a1c3200) 00010000:00010000:1.0:1787583274.374781:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787583274.374782:0:20292:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787583274.374909:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+10:15598:x1874416413832064:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 11292us (12835us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787583274.374924:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1787583274.507975:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583274.508195:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413832320 00000100:00100000:0.0:1787583274.508205:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413832320 00000100:00100000:0.0:1787583274.508275:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:0.0:1787583274.508286:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+10:15606:x1874416413832320:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:0.0:1787583274.508335:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583274.508357:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1c00/0x19a47956376b78c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4662 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.508419:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b78cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.508431:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b78cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.508443:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b78cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583274.508481:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787583274.508485:0:17155:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583274.508549:0:17155:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b78cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.508572:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1c00/0x19a47956376b78c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4662 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.508710:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1400/0x19a47956376b78cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4662 expref: 11 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.508721:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90936a1c3400) 00010000:00010000:0.0:1787583274.508724:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787583274.508727:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9092464f1400, rc 0) 00000100:00100000:0.0:1787583274.508787:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+11:15606:x1874416413832320:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 503us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.508795:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:0.0:1787583274.528268:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.528417:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413832448 00000100:00100000:2.0:1787583274.528427:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413832448 00000100:00100000:2.0:1787583274.528485:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:2.0:1787583274.528495:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d729bb3e-ce60-4d36-b85a-27ad79fddcea+5:15607:x1874416413832448:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583274.528523:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583274.528549:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4669 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.528615:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.528628:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.528639:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583274.528682:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787583274.528687:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583274.528709:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.528731:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4669 expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.528749:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344ded800/0x19a47956376b78dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4669 expref: 6 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.528774:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90936a1c3400) 00010000:00010000:2.0:1787583274.528776:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787583274.528780:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344ded800, rc 0) 00000100:00100000:2.0:1787583274.528839:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:15607:x1874416413832448:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 345us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583274.528891:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1787583274.533559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.533686:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413832576 00000100:00100000:2.0:1787583274.533695:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413832576 00000100:00100000:2.0:1787583274.533749:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:2.0:1787583274.533758:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d729bb3e-ce60-4d36-b85a-27ad79fddcea+6:15607:x1874416413832576:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583274.533777:0:20292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583274.533794:0:20292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4670 expref: -99 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.533885:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b78eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.533898:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b78eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.533908:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b78eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.533919:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b78f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.533926:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b78f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.533952:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b78f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.534036:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.534044:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.534457:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583274.534497:0:20292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787583274.534500:0:20292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583274.534517:0:20292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.534528:0:20292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b78eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.534740:0:20292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b78eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.534750:0:20292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b78eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.534756:0:20292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344deca00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583274.534760:0:20292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b78eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.534768:0:20292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b78eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.534788:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90936a1c3400) 00010000:00010000:2.0:1787583274.534791:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583274.534795:0:20292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b78eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.534800:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b78eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.534813:0:20292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b78f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.534820:0:20292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b78f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.535089:0:20292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b78f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.535096:0:20292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dece00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583274.535099:0:20292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b78f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.535105:0:20292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b78f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.535114:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90936a1c3200) 00010000:00010000:2.0:1787583274.535116:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583274.535119:0:20292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b78f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.535124:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b78f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.535163:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b78e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4670 expref: 8 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.535176:0:20292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4670 expref: 7 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.535184:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90936a0aef00) 00010000:00010000:2.0:1787583274.535186:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787583274.535189:0:20292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dec200, rc 0) 00000100:00100000:2.0:1787583274.535255:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d729bb3e-ce60-4d36-b85a-27ad79fddcea+7:15607:x1874416413832576:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1497us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583274.535264:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:1.0:1787583274.543474:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583274.543823:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413832704 00000100:00100000:0.0:1787583274.543861:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413832704 00000100:00100000:0.0:1787583274.544058:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:0.0:1787583274.544072:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+5:15607:x1874416413832704:12345-192.168.203.11@tcp:900:lfs.0 00000100:00100000:0.0:1787583274.544155:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+5:15607:x1874416413832704:12345-192.168.203.11@tcp:900:lfs.0 Request processed in 86us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.545370:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1787583274.548008:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.548222:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413832960 00000100:00100000:2.0:1787583274.548232:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413832960 00000100:00100000:2.0:1787583274.548294:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1787583274.548397:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+7:15607:x1874416413832960:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583274.548417:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583274.548436:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7900 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4677 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583274.548524:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787583274.548744:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7900 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4677 expref: 9 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.548759:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90936a1c3400) 00010000:00010000:2.0:1787583274.548763:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787583274.548779:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7900 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4677 expref: 9 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.548795:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dec600, rc 0) 00000100:00100000:2.0:1787583274.548895:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+8:15607:x1874416413832960:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 502us (896us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787583274.548903:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:1.0:1787583274.555988:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583274.556067:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413833216 00000100:00100000:3.0:1787583274.556078:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413833216 00000100:00100000:3.0:1787583274.556139:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1787583274.556149:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d729bb3e-ce60-4d36-b85a-27ad79fddcea+8:15607:x1874416413833216:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:3.0:1787583274.556197:0:18681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583274.556223:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b78f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4670 expref: 8 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.556243:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90936a0aef00) 00010000:00010000:3.0:1787583274.556248:0:18681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787583274.556268:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b790e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.556291:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b790e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.556311:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b790e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787583274.556489:0:18681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044852f69 reply state 000000000a511b7f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b790e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.556501:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b790e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.556507:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90936a0aef00) 00010000:00010000:3.0:1787583274.556510:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787583274.556512:0:18681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787583274.556518:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787583274.556611:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d729bb3e-ce60-4d36-b85a-27ad79fddcea+9:15607:x1874416413833216:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 463us (632us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787583274.556618:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1787583274.558800:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.558946:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413833472 00000100:00100000:2.0:1787583274.558956:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413833472 00000100:00100000:2.0:1787583274.559015:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:2.0:1787583274.559025:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+9:15607:x1874416413833472:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1787583274.559223:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+10:15607:x1874416413833472:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 199us (432us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787583274.559231:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:1.0:1787583274.564021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.564087:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413833728 00000100:00100000:2.0:1787583274.564097:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413833728 00000100:00100000:2.0:1787583274.564156:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:2.0:1787583274.564167:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d729bb3e-ce60-4d36-b85a-27ad79fddcea+10:15607:x1874416413833728:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583274.564191:0:20292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583274.564210:0:20292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7915 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c467e expref: -99 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564278:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b791c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564292:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b791c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564329:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b791c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564341:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b7923 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564348:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b7923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564353:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b7923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583274.564441:0:20292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787583274.564507:0:20292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b791c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564515:0:20292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b791c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564522:0:20292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b791c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564528:0:20292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dece00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583274.564532:0:20292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b791c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564548:0:20292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b791c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564562:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90936a1c3400) 00010000:00010000:2.0:1787583274.564565:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583274.564575:0:20292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b791c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564581:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b791c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564596:0:20292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b7923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564602:0:20292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b7923 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564608:0:20292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b7923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564612:0:20292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344deca00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583274.564615:0:20292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b7923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564621:0:20292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b7923 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564628:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90936a1c3200) 00010000:00010000:2.0:1787583274.564631:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583274.564633:0:20292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b7923 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564638:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b7923 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564671:0:20292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7915 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c467e expref: 12 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564691:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90936a1c3400) 00010000:00010000:2.0:1787583274.564693:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787583274.564696:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7915 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c467e expref: 12 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.564705:0:20292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dec600, rc 0) 00000100:00100000:2.0:1787583274.564769:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d729bb3e-ce60-4d36-b85a-27ad79fddcea+11:15607:x1874416413833728:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 603us (758us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787583274.564776:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1787583274.568285:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.568453:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413833856 00000100:00100000:2.0:1787583274.568463:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413833856 00000100:00100000:2.0:1787583274.568517:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:2.0:1787583274.568527:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+11:15607:x1874416413833856:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583274.568558:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583274.568578:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7931 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4685 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.568669:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7938 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.568682:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7938 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.568692:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7938 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583274.568716:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787583274.568736:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583274.568759:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7938 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.568783:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7931 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4685 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.568800:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7938 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4685 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.568811:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90936a0aef00) 00010000:00010000:2.0:1787583274.568814:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787583274.568817:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dec200, rc 0) 00000100:00100000:2.0:1787583274.569136:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+12:15607:x1874416413833856:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 608us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583274.569143:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1787583274.572272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.572361:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413833984 00000100:00100000:2.0:1787583274.572370:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413833984 00000100:00100000:2.0:1787583274.572425:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1787583274.572436:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+12:15607:x1874416413833984:12345-192.168.203.11@tcp:37:lfs.0 00000100:00100000:2.0:1787583274.579059:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d729bb3e-ce60-4d36-b85a-27ad79fddcea+12:15607:x1874416413833984:12345-192.168.203.11@tcp:37:lfs.0 Request processed in 6615us (6788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583274.579073:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1787583274.582672:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583274.582767:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413834240 00000100:00100000:3.0:1787583274.582778:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413834240 00000100:00100000:3.0:1787583274.582890:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1787583274.582901:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fbee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d729bb3e-ce60-4d36-b85a-27ad79fddcea+12:15607:x1874416413834240:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1787583274.583111:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fbee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d729bb3e-ce60-4d36-b85a-27ad79fddcea+13:15607:x1874416413834240:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 211us (446us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787583274.583118:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1787583274.630534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583274.630611:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413834368 00000100:00100000:0.0:1787583274.630621:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413834368 00000100:00100000:0.0:1787583274.630683:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:0.0:1787583274.630694:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+11:15613:x1874416413834368:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1787583274.630713:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583274.630733:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1200/0x19a47956376b793f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c468c expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.630797:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7946 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.630811:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.630833:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.630890:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0c00/0x19a47956376b794d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.630899:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0c00/0x19a47956376b794d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.630927:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0c00/0x19a47956376b794d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631006:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0200/0x19a47956376b7954 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631015:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0200/0x19a47956376b7954 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631023:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0200/0x19a47956376b7954 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787583274.631059:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787583274.631063:0:17155:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787583274.631099:0:17155:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0200/0x19a47956376b7954 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631111:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631117:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7946 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631124:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7946 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631130:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583274.631134:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7946 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631141:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7946 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631160:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90936a1c3400) 00010000:00010000:0.0:1787583274.631163:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583274.631170:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7946 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631176:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7946 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631192:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0c00/0x19a47956376b794d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631198:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0c00/0x19a47956376b794d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631204:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0c00/0x19a47956376b794d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631208:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0c00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583274.631211:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0c00/0x19a47956376b794d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631216:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0c00/0x19a47956376b794d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631223:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90936a1c3200) 00010000:00010000:0.0:1787583274.631225:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583274.631228:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0c00/0x19a47956376b794d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631233:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0c00/0x19a47956376b794d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631270:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1200/0x19a47956376b793f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c468c expref: 13 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631282:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0200/0x19a47956376b7954 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c468c expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583274.631289:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90936a0aef00) 00010000:00010000:0.0:1787583274.631291:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787583274.631294:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9092464f0200, rc 0) 00000100:00100000:0.0:1787583274.631360:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+12:15613:x1874416413834368:12345-192.168.203.11@tcp:101:bash.0 Request processed in 669us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583274.631368:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:1.0:1787583274.639287:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583274.639406:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413834496 00000100:00100000:3.0:1787583274.639425:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413834496 00000100:00100000:3.0:1787583274.639472:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1787583274.639482:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90936d83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:15613:x1874416413834496:12345-192.168.203.11@tcp:900:bash.0 00000100:00100000:3.0:1787583274.639633:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90936d83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:15613:x1874416413834496:12345-192.168.203.11@tcp:900:bash.0 Request processed in 152us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583274.639641:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1787583274.645836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583274.647669:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413834752 00000100:00100000:3.0:1787583274.647683:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413834752 00000100:00100000:3.0:1787583274.647759:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:3.0:1787583274.647771:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+12:15613:x1874416413834752:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1787583274.647792:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583274.647813:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b795b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4693 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.647968:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.647983:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7938 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4685 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.647993:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.648028:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7938 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4685 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.648043:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7938 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4685 expref: 12 pid: 17154 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583274.648087:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17153:1874416435932288:192.168.203.11@tcp:104: 00000100:00100000:3.0:1787583274.648175:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff909344b3dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787583274.650410:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17153:1874416435932288:192.168.203.11@tcp:104: 00010000:00010000:3.0:1787583274.650447:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583274.651361:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583274.652083:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413834880 00000100:00100000:3.0:1787583274.652093:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413834880 00010000:00010000:3.0:1787583274.652128:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7938 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4685 expref: 13 pid: 17154 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583274.652223:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1787583274.652234:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d729bb3e-ce60-4d36-b85a-27ad79fddcea+13:2406:x1874416413834880:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583274.652249:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583274.652257:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7938 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4685 expref: 13 pid: 17154 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.652271:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7938 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4685 expref: 13 pid: 17154 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.652293:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7938 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4685 expref: 13 pid: 17154 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.652321:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90936a0aef00) 00010000:00010000:3.0:1787583274.652363:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.652385:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.652392:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.652425:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583274.652486:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d729bb3e-ce60-4d36-b85a-27ad79fddcea+12:2406:x1874416413834880:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 253us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583274.652494:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00010000:00010000:2.0:1787583274.652555:0:17153:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.652564:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.652604:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7969 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.652614:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7969 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.652621:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7969 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653091:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7970 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653101:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7970 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653108:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7970 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583274.653116:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787583274.653139:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653146:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653152:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653157:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f400 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583274.653161:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653177:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653187:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90936a0aef00) 00010000:00010000:2.0:1787583274.653190:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583274.653194:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653199:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f400/0x19a47956376b7962 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787583274.653209:0:17153:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7bae980 reply state 0000000041299691 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7969 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653219:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7969 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653224:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff909345181100) 00010000:00010000:2.0:1787583274.653226:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787583274.653229:0:17153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787583274.653260:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b795b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4693 expref: 15 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653274:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7970 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4693 expref: 14 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.653280:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:2.0:1787583274.653282:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787583274.653284:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dec600, rc 0) 00000100:00100000:2.0:1787583274.653350:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+15:15613:x1874416413834752:12345-192.168.203.11@tcp:101:bash.0 Request processed in 5582us (7538us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787583274.653358:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:1.0:1787583274.682441:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583274.683014:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413835008 00000100:00100000:3.0:1787583274.683025:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413835008 00000100:00100000:3.0:1787583274.683081:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:3.0:1787583274.683092:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+15:15613:x1874416413835008:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1787583274.683183:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787583274.683207:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b797e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c469a expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.683281:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.683296:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.683316:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583274.683370:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787583274.683446:0:18681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787583274.683484:0:18681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.683496:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.683521:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b797e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c469a expref: 17 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.684195:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c469a expref: 16 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583274.684205:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:3.0:1787583274.684208:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787583274.684211:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90936367f800, rc 0) 00000100:00100000:2.0:1787583274.684480:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+16:15613:x1874416413835008:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1388us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583274.684489:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:1.0:1787583274.698185:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.698312:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413835264 00000100:00100000:2.0:1787583274.698322:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413835264 00000100:00100000:2.0:1787583274.698427:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1787583274.698439:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+16:15613:x1874416413835264:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1787583274.698765:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+17:15613:x1874416413835264:12345-192.168.203.11@tcp:35:bash.0 Request processed in 326us (585us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787583274.698773:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:0.0:1787583274.764950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.765090:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413835520 00000100:00100000:2.0:1787583274.765101:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413835520 00000100:00100000:2.0:1787583274.765192:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1787583274.765203:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+17:15623:x1874416413835520:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583274.765227:0:20292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583274.765246:0:20292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b798c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46a1 expref: -99 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583274.765381:0:20292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787583274.765490:0:20292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b798c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46a1 expref: 19 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.765505:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90936a1c3400) 00010000:00010000:2.0:1787583274.765515:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787583274.765521:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b798c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46a1 expref: 19 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.765537:0:20292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344deca00, rc 0) 00000100:00100000:2.0:1787583274.765605:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+18:15623:x1874416413835520:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 404us (664us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787583274.765612:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:1.0:1787583274.767557:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583274.767610:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413835776 00000100:00100000:3.0:1787583274.767618:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413835776 00000100:00100000:3.0:1787583274.767668:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1787583274.767679:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+18:15623:x1874416413835776:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1787583274.767926:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+19:15623:x1874416413835776:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 248us (386us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787583274.767936:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1787583274.804429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.804601:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413836032 00000100:00100000:2.0:1787583274.804620:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413836032 00000100:00100000:2.0:1787583274.804685:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:2.0:1787583274.804695:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+19:15626:x1874416413836032:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1787583274.804721:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583274.804736:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b799a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46a8 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.804833:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b79a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.804877:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b79a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.804890:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b79a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583274.804897:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787583274.805038:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b799a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46a8 expref: 22 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.805098:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b79a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46a8 expref: 21 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.805108:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:2.0:1787583274.805111:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583274.805115:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dece00, rc 0) 00000100:00100000:2.0:1787583274.805245:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+21:15626:x1874416413836032:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 551us (825us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787583274.805260:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1787583274.811380:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.811427:0:20179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413836160 00000100:00100000:2.0:1787583274.811435:0:20179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413836160 00000100:00100000:0.0:1787583274.811442:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.811521:0:20179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1787583274.811532:0:20179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+21:2406:x1874416413836160:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787583274.811651:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413836288 00000100:00100000:1.0:1787583274.811655:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413836288 00000100:00100000:1.0:1787583274.811688:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:1.0:1787583274.811698:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+22:15626:x1874416413836288:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:1.0:1787583274.811756:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924149aa00/0x19a47956376b79af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.811892:0:20179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583274.811917:0:20179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b79a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46a8 expref: 22 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.812027:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924149aa00/0x19a47956376b79af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.812049:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924149aa00/0x19a47956376b79af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.812088:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924149aa00/0x19a47956376b79af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.812095:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924149aa00/0x19a47956376b79af lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.812101:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924149aa00/0x19a47956376b79af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.812106:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924149aa00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:1.0:1787583274.812110:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924149aa00/0x19a47956376b79af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583274.812113:0:20179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:2.0:1787583274.812117:0:20179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583274.812118:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924149aa00/0x19a47956376b79af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.812126:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:1.0:1787583274.812128:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787583274.812131:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924149aa00/0x19a47956376b79af lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583274.812137:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924149aa00/0x19a47956376b79af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583274.812180:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+21:15626:x1874416413836288:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 481us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583274.812183:0:20179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+21:2406:x1874416413836160:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 646us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583274.812187:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:2.0:1787583274.812190:0:20179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:1.0:1787583274.814108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583274.814144:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413836544 00000100:00100000:2.0:1787583274.814151:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413836544 00000100:00100000:2.0:1787583274.814229:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1787583274.814252:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+20:15626:x1874416413836544:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1787583274.814469:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+21:15626:x1874416413836544:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 218us (368us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787583274.814476:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00010000:00010000:1.0:1787583274.830574:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787583275.116318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.117437:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413836800 00000100:00100000:2.0:1787583275.117450:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413836800 00000100:00100000:2.0:1787583275.117517:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1787583275.117528:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+21:15657:x1874416413836800:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:2.0:1787583275.117549:0:20292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583275.117567:0:20292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b79b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46af expref: -99 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.117672:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.117685:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.117697:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583275.117706:0:20292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787583275.117817:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b79b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46af expref: 24 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.117835:0:20292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46af expref: 23 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.117906:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:2.0:1787583275.117909:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583275.117912:0:20292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344deca00, rc 0) 00000100:00100000:2.0:1787583275.117973:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+23:15657:x1874416413836800:12345-192.168.203.11@tcp:101:cat.0 Request processed in 446us (1677us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787583275.117979:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:0.0:1787583275.125789:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583275.125902:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413836928 00000100:00100000:1.0:1787583275.125913:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413836928 00000100:00100000:1.0:1787583275.125979:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:1.0:1787583275.125990:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352913100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+23:2406:x1874416413836928:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583275.126004:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583275.126026:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46af expref: 23 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.126055:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:1.0:1787583275.126060:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583275.126118:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352913100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+22:2406:x1874416413836928:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 129us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583275.126124:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:1.0:1787583275.131234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583275.131674:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413837184 00000100:00100000:3.0:1787583275.131683:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413837184 00000100:00100000:3.0:1787583275.131744:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1787583275.131756:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+22:15657:x1874416413837184:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:3.0:1787583275.132665:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+23:15657:x1874416413837184:12345-192.168.203.11@tcp:35:cat.0 Request processed in 905us (1434us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787583275.132688:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:0.0:1787583275.212102:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.212388:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413837440 00000100:00100000:2.0:1787583275.212398:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413837440 00000100:00100000:2.0:1787583275.212495:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:2.0:1787583275.212506:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+23:15663:x1874416413837440:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1787583275.212529:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583275.212548:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b79cb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46b6 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.212648:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.212662:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7970 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4693 expref: 24 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.212669:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c469a expref: 24 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.212677:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79d2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.212710:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c469a expref: 24 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.212748:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c469a expref: 24 pid: 18681 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583275.212763:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17153:1874416435932416:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583275.212883:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7970 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4693 expref: 24 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.212892:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7970 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4693 expref: 24 pid: 17153 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583275.212901:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17153:1874416435932544:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583275.212928:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f227000 going to sleep for 11 seconds 00000040:00080000:0.0:1787583275.214702:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787583275.216510:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.216627:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17153:1874416435932416:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583275.216639:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17153:1874416435932544:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583275.216663:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583275.216732:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583275.216958:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413837568 00000100:00100000:3.0:1787583275.216971:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413837568 00010000:00010000:3.0:1787583275.217006:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7970 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4693 expref: 25 pid: 17153 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583275.217042:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413837696 00000100:00100000:3.0:1787583275.217045:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413837696 00010000:00010000:3.0:1787583275.217058:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c469a expref: 26 pid: 18681 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583275.217079:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1787583275.217088:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352913b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+26:2407:x1874416413837568:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583275.217102:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583275.217109:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7970 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4693 expref: 26 pid: 17153 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.217125:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7970 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4693 expref: 26 pid: 17153 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.217147:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7970 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4693 expref: 26 pid: 17153 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583275.217161:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00010000:00010000:3.0:1787583275.217166:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:3.0:1787583275.217172:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583275.217174:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+25:2407:x1874416413837696:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583275.217191:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583275.217200:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c469a expref: 25 pid: 18681 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.217205:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.217219:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787583275.217225:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c469a expref: 25 pid: 18681 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.217241:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367f800/0x19a47956376b7985 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c469a expref: 25 pid: 18681 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583275.217267:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352913b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+25:2407:x1874416413837568:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 179us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583275.217277:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00010000:00010000:1.0:1787583275.217279:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:1.0:1787583275.217286:0:17140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.217303:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.217311:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79d2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.217338:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787583275.217360:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+23:2407:x1874416413837696:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 191us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583275.217368:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00010000:00010000:3.0:1787583275.217733:0:17153:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.217743:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787583275.217760:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787583275.218659:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b79cb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46b6 expref: 24 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.218682:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344deca00/0x19a47956376b79d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46b6 expref: 23 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.218690:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:2.0:1787583275.218700:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787583275.218704:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344deca00, rc 0) 00000100:00100000:2.0:1787583275.218749:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+23:15663:x1874416413837440:12345-192.168.203.11@tcp:101:dd.0 Request processed in 6245us (6656us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787583275.218756:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:0.0:1787583275.221079:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583275.221576:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413837824 00000100:00100000:1.0:1787583275.221586:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413837824 00000100:00100000:2.0:1787583275.221957:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:2.0:1787583275.221969:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+23:15663:x1874416413837824:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1787583275.221994:0:20292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583275.222015:0:20292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b79e0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46bd expref: -99 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.222060:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b79e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.222074:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b79e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.222084:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b79e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.222190:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b79e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46bd expref: 25 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.222209:0:20292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b79e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46bd expref: 24 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.222217:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:2.0:1787583275.222220:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787583275.222229:0:20292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713ea00, rc 0) 00000100:00100000:2.0:1787583275.222277:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+24:15663:x1874416413837824:12345-192.168.203.11@tcp:101:dd.0 Request processed in 311us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.222284:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:1.0:1787583275.228435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583275.228531:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413838080 00000100:00100000:0.0:1787583275.228541:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413838080 00000100:00100000:2.0:1787583275.228625:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1787583275.228640:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+24:15663:x1874416413838080:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:2.0:1787583275.228857:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b79ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.228873:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b79ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.228882:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b79ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787583275.228919:0:17154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787583275.228937:0:17154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e0eb456 reply state 00000000e74229d6 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b79ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.228948:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b79ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.228955:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:2.0:1787583275.228958:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787583275.228961:0:17154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787583275.229038:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+27:15663:x1874416413838080:12345-192.168.203.11@tcp:36:dd.0 Request processed in 402us (612us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787583275.229044:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000020:00080000:2.0:1787583275.229048:0:17154:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787583275.232245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.235071:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413838208 00000100:00100000:2.0:1787583275.235216:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413838208 00000100:00100000:2.0:1787583275.235350:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1787583275.235362:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+27:15663:x1874416413838208:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1787583275.235388:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583275.235409:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b79f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46c4 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.235468:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b79f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46c4 expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.235482:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b79f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46c4 expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.235500:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:2.0:1787583275.235503:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787583275.235506:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f800, rc 0) 00000100:00100000:2.0:1787583275.235577:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+28:15663:x1874416413838208:12345-192.168.203.11@tcp:101:dd.0 Request processed in 217us (3337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.235593:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:0.0:1787583275.245148:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583275.245248:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413838464 00000100:00100000:3.0:1787583275.245258:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413838464 00000100:00100000:3.0:1787583275.245343:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1787583275.245354:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+28:15663:x1874416413838464:12345-192.168.203.11@tcp:103:dd.0 00010000:00010000:3.0:1787583275.245369:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583275.245393:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b79f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46c4 expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.245422:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:3.0:1787583275.245426:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583275.245490:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+27:15663:x1874416413838464:12345-192.168.203.11@tcp:103:dd.0 Request processed in 138us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583275.245498:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1787583275.248682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.248781:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413838592 00000100:00100000:2.0:1787583275.248790:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413838592 00000100:00100000:2.0:1787583275.248968:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:2.0:1787583275.248977:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+27:15663:x1874416413838592:12345-192.168.203.11@tcp:58:dd.0 00010000:00010000:2.0:1787583275.249059:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b79fc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.249071:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b79fc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.249091:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b79fc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787583275.250064:0:20292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787583275.251369:0:20292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787583275.251530:0:20292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787583275.251629:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+27:15663:x1874416413838592:12345-192.168.203.11@tcp:58:dd.0 Request processed in 2649us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.251640:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:1.0:1787583275.253737:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.253790:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413838720 00000100:00100000:2.0:1787583275.253800:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413838720 00000100:00100000:2.0:1787583275.253880:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:2.0:1787583275.253891:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+27:15663:x1874416413838720:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1787583275.253910:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583275.253930:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b7a03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46cb expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.253979:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b79fc lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.253989:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b7a03 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46cb expref: 28 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.254007:0:17154:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b79fc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.254019:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b7a03 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46cb expref: 28 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.254044:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:2.0:1787583275.254047:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787583275.254049:0:17154:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b7a03 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46cb expref: 28 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.254055:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f000, rc 0) 00000100:00100000:2.0:1787583275.254096:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+28:15663:x1874416413838720:12345-192.168.203.11@tcp:101:dd.0 Request processed in 208us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.254104:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000040:00080000:3.0:1787583275.278615:0:17189:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787583275.278624:0:17189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787583275.278651:0:17189:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787583275.278657:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787583275.278779:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247f8e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17189:1874416435932672:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787583275.278899:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936ef419c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583275.281982:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247f8e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17189:1874416435932672:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787583275.283049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.283154:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413838848 00000100:00100000:2.0:1787583275.283162:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413838848 00000100:00100000:2.0:1787583275.283211:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1787583275.283221:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+28:15664:x1874416413838848:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787583275.283252:0:17153:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787583275.283379:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+28:15664:x1874416413838848:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 159us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.283386:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:1.0:1787583275.287364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.287484:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413838976 00000100:00100000:2.0:1787583275.287494:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413838976 00000100:00100000:2.0:1787583275.287723:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1787583275.287736:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+28:15664:x1874416413838976:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787583275.287803:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a0a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.287819:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.287843:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.287958:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a11 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.287966:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.287973:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.287996:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a18 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288004:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288011:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583275.288051:0:20292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787583275.288056:0:20292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583275.288070:0:20292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288080:0:20292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288086:0:20292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a0a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288103:0:20292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288108:0:20292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713ec00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583275.288112:0:20292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288119:0:20292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a0a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288131:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff909345181c00) 00010000:00010000:2.0:1787583275.288134:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583275.288139:0:20292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a0a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288145:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a0a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288158:0:20292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288164:0:20292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a11 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288169:0:20292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288174:0:20292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713f800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583275.288177:0:20292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288192:0:20292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a11 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288201:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff909345181000) 00010000:00010000:2.0:1787583275.288203:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583275.288206:0:20292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a11 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288211:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a11 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288224:0:20292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288231:0:20292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a18 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288236:0:20292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288241:0:20292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583275.288244:0:20292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288249:0:20292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a18 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288332:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:2.0:1787583275.288336:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583275.288339:0:20292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a18 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.288353:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583275.288478:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+28:15664:x1874416413838976:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 743us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.288487:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:0.0:1787583275.291012:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.291168:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413839232 00000100:00100000:2.0:1787583275.291176:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413839232 00000100:00100000:2.0:1787583275.291246:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:2.0:1787583275.291254:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+28:15664:x1874416413839232:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583275.291270:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583275.291285:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7a1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46d2 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.291385:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b7a26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.291395:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b7a26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.291403:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b7a26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583275.291411:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787583275.291488:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b7a26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.291495:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b7a26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.291565:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b7a26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.291570:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dece00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583275.291573:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b7a26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.291578:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b7a26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.291629:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:2.0:1787583275.291631:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787583275.291634:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b7a26 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.291638:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dece00/0x19a47956376b7a26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.291670:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7a1f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46d2 expref: 30 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.291678:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff909345181c00) 00010000:00010000:2.0:1787583275.291680:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787583275.291684:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec600/0x19a47956376b7a1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46d2 expref: 30 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.291693:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff909344dec600, rc 0) 00000100:00100000:2.0:1787583275.291806:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+29:15664:x1874416413839232:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 551us (801us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787583275.291823:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:3.0:1787583275.294201:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.294426:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413839360 00000100:00100000:2.0:1787583275.294435:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413839360 00000100:00100000:2.0:1787583275.294490:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:2.0:1787583275.294501:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+29:15664:x1874416413839360:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787583275.294694:0:17153:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787583275.294882:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+29:15664:x1874416413839360:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 382us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.294890:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:1.0:1787583275.298324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.298408:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413839616 00000100:00100000:2.0:1787583275.298418:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413839616 00000100:00100000:2.0:1787583275.298508:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:2.0:1787583275.298518:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+29:15664:x1874416413839616:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583275.298537:0:20292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583275.298555:0:20292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a34 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46d9 expref: -99 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787583275.298900:0:20292:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1787583275.298905:0:20292:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787583275.298919:0:20292:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1787583275.299020:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.299031:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.299038:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.299087:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec200/0x19a47956376b7a34 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46d9 expref: 32 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.299100:0:20292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46d9 expref: 31 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.299106:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff909345181000) 00010000:00010000:2.0:1787583275.299108:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787583275.299110:0:20292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924713f800, rc 0) 00000100:00100000:2.0:1787583275.299161:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+31:15664:x1874416413839616:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 645us (846us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787583275.299166:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:0.0:1787583275.301344:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.301396:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413839872 00000100:00100000:2.0:1787583275.301406:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413839872 00000100:00100000:2.0:1787583275.301457:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:2.0:1787583275.301468:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+31:15664:x1874416413839872:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787583275.301517:0:17154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583275.301540:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f800/0x19a47956376b7a3b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46d9 expref: 31 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301559:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff909345181000) 00010000:00010000:2.0:1787583275.301568:0:17154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583275.301588:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a49 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301602:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301618:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301648:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a50 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe1bee696 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301657:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1bee696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301665:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1bee696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301708:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301715:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a49 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301722:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a49 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301729:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713ec00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583275.301733:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a49 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301754:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a49 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301763:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90936a0aef00) 00010000:00010000:2.0:1787583275.301766:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583275.301769:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a49 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301781:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ec00/0x19a47956376b7a49 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301791:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1bee696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301798:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a50 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1bee696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301805:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1bee696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301810:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583275.301814:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1bee696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301821:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a50 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1bee696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301835:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe1bee696 (ffff909345181600) 00010000:00010000:2.0:1787583275.301837:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787583275.301841:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a50 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe1bee696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.301870:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a50 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe1bee696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583275.301949:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+30:15664:x1874416413839872:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 482us (609us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787583275.301959:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:3.0:1787583275.303428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.306135:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413840000 00000100:00100000:2.0:1787583275.306148:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413840000 00000100:00100000:2.0:1787583275.306209:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:2.0:1787583275.306283:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+30:15664:x1874416413840000:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583275.306313:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583275.306335:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b7a57 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46e0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.306370:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770aa00/0x19a47956376b7a5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.306384:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770aa00/0x19a47956376b7a5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.306396:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770aa00/0x19a47956376b7a5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.306501:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b7a57 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46e0 expref: 32 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.306518:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770aa00/0x19a47956376b7a5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46e0 expref: 31 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.306526:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff909345181d00) 00010000:00010000:2.0:1787583275.306529:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787583275.306532:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770aa00, rc 0) 00000100:00100000:2.0:1787583275.306597:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+31:15664:x1874416413840000:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 318us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.306605:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:1.0:1787583275.310346:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.310695:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413840256 00000100:00100000:2.0:1787583275.310705:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413840256 00000100:00100000:2.0:1787583275.310801:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:2.0:1787583275.310812:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+31:15664:x1874416413840256:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787583275.310915:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b800/0x19a47956376b7a65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.310932:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b800/0x19a47956376b7a65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.310943:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b800/0x19a47956376b7a65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787583275.311104:0:20292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787583275.311115:0:20292:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 582464268273ns, next at 583464265671ns, rc = 0 00000004:00010000:2.0:1787583275.311162:0:20292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016a76a79 reply state 00000000c893aa5b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b800/0x19a47956376b7a65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.311175:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b800/0x19a47956376b7a65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.311182:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff909345181d00) 00010000:00010000:2.0:1787583275.311185:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787583275.311188:0:20292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787583275.311285:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+33:15664:x1874416413840256:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 473us (943us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787583275.311302:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:0.0:1787583275.313171:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.313207:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413840384 00000100:00100000:2.0:1787583275.313214:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413840384 00000100:00100000:2.0:1787583275.313254:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1787583275.313263:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+33:15664:x1874416413840384:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583275.313291:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583275.313315:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a400/0x19a47956376b7a6c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46e7 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.313353:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a400/0x19a47956376b7a6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46e7 expref: 34 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.313370:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a400/0x19a47956376b7a6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46e7 expref: 34 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.313382:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff909345181d00) 00010000:00010000:2.0:1787583275.313384:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787583275.313387:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a400, rc 0) 00000100:00100000:2.0:1787583275.313577:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+34:15664:x1874416413840384:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 314us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.313584:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:3.0:1787583275.316327:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583275.316956:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413840512 00000100:00100000:0.0:1787583275.316967:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413840512 00000100:00100000:0.0:1787583275.317026:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1787583275.317037:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2407:x1874416413840512:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787583275.317291:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:2407:x1874416413840512:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 252us (968us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787583275.317313:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1787583275.321569:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.321781:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413840768 00000100:00100000:2.0:1787583275.321791:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413840768 00000100:00100000:3.0:1787583275.322060:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:3.0:1787583275.322089:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+34:15664:x1874416413840768:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787583275.322397:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+35:15664:x1874416413840768:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 314us (836us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787583275.322403:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1787583275.324455:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.325023:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413841024 00000100:00100000:2.0:1787583275.325033:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413841024 00000100:00100000:2.0:1787583275.325097:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:2.0:1787583275.325107:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+35:15664:x1874416413841024:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787583275.325206:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+35:15664:x1874416413841024:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 100us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.325215:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:1.0:1787583275.327940:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.328026:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413841152 00000100:00100000:2.0:1787583275.328035:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413841152 00000100:00100000:2.0:1787583275.328106:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:2.0:1787583275.328117:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+35:15664:x1874416413841152:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583275.328135:0:20292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583275.328155:0:20292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b7a73 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46ee expref: -99 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.328214:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.328227:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.328238:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787583275.328280:0:20292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787583275.328311:0:20292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.328336:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b000/0x19a47956376b7a73 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46ee expref: 37 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.328352:0:20292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46ee expref: 36 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.328360:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff909345181d00) 00010000:00010000:2.0:1787583275.328362:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787583275.328366:0:20292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a000, rc 0) 00000100:00100000:2.0:1787583275.328420:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+36:15664:x1874416413841152:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 306us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.328436:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:0.0:1787583275.331157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.331245:0:19228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413841280 00000100:00100000:2.0:1787583275.331254:0:19228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413841280 00000100:00100000:2.0:1787583275.331358:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1787583275.331368:0:19228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+6:2406:x1874416413841280:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583275.331384:0:19228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583275.331405:0:19228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0c87b48/0x19a47956376b7a81 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46f5 expref: -99 pid: 19228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787583275.331431:0:19228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c5b2a, blocks: 0x0 00010000:00010000:2.0:1787583275.331449:0:19228:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1787583275.331454:0:19228:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583275.331464:0:19228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c87b48/0x19a47956376b7a81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46f5 expref: 7 pid: 19228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.331483:0:19228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c0c87b48/0x19a47956376b7a81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46f5 expref: 7 pid: 19228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.331497:0:19228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770b200, rc 0) 00000100:00100000:2.0:1787583275.331566:0:19228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:2406:x1874416413841280:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 198us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.331574:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1787583275.339694:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583275.340011:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413841536 00000100:00100000:0.0:1787583275.340020:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413841536 00000100:00100000:0.0:1787583275.340078:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:0.0:1787583275.340090:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+36:15664:x1874416413841536:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787583275.340814:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+36:15664:x1874416413841536:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 722us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583275.340824:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:1.0:1787583275.344704:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.344770:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413841664 00000100:00100000:2.0:1787583275.344780:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413841664 00000100:00100000:2.0:1787583275.345011:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:2.0:1787583275.345023:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+36:15664:x1874416413841664:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787583275.347020:0:17133:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1787583275.347034:0:17133:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787583275.347089:0:17133:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1787583275.347182:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093668a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435932800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787583275.347222:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+19:15664:x1874416413841664:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 2199us (2524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583275.347232:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00010000:00010000:2.0:1787583275.347358:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b790e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.347370:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b790e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.347378:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b790e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.347390:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e200 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:2.0:1787583275.347396:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b790e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.347404:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b790e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.347433:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90936a0aef00) 00010000:00010000:2.0:1787583275.347437:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787583275.347442:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b790e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.347458:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e200/0x19a47956376b790e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583275.347460:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583275.347528:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435932800 00000100:00100000:3.0:1787583275.347535:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435932800 00000100:00100000:3.0:1787583275.347580:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787583275.347595:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435932800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787583275.347703:0:18659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787583275.347707:0:18659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787583275.347709:0:18659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787583275.347711:0:18659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787583274 -> 1787583274 00002000:00010000:3.0:1787583275.347714:0:18659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787583275.347755:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1874416435932800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (295us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787583275.347762:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:1.0:1787583275.347797:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9093668a1880/2, rc 0, transno 8589934596 00000100:00100000:1.0:1787583275.347804:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093668a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435932800:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1787583275.347814:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787583275.348247:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b78ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348254:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b78ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348258:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b78ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348261:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583275.348263:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b78ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348277:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b78ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348284:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90936a1c3200) 00010000:00010000:0.0:1787583275.348285:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583275.348287:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b78ba lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348291:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b78ba lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348317:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ae00/0x19a47956376b78c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348323:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ae00/0x19a47956376b78c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348329:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ae00/0x19a47956376b78c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348335:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924149ae00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583275.348337:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ae00/0x19a47956376b78c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348343:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ae00/0x19a47956376b78c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348351:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90936a0aef00) 00010000:00010000:0.0:1787583275.348354:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583275.348357:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ae00/0x19a47956376b78c1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348368:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924149ae00/0x19a47956376b78c1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348377:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7969 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348381:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7969 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348384:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7969 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348387:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff909344dec800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583275.348389:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7969 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348392:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7969 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348396:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff909345181100) 00010000:00010000:0.0:1787583275.348398:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583275.348399:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7969 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348402:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff909344dec800/0x19a47956376b7969 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348412:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b79ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348416:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b79ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348424:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b79ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348429:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fa00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583275.348432:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b79ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348438:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b79ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348679:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:0.0:1787583275.348681:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583275.348685:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b79ee lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348692:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fa00/0x19a47956376b79ee lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348704:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b800/0x19a47956376b7a65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348710:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b800/0x19a47956376b7a65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348714:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b800/0x19a47956376b7a65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348717:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770b800 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583275.348719:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b800/0x19a47956376b7a65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348730:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b800/0x19a47956376b7a65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348736:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff909345181d00) 00010000:00010000:0.0:1787583275.348737:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787583275.348739:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b800/0x19a47956376b7a65 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.348743:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770b800/0x19a47956376b7a65 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583275.349067:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583275.349124:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413841792 00000100:00100000:0.0:1787583275.349130:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413841792 00000100:00100000:0.0:1787583275.349169:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:0.0:1787583275.349179:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:2407:x1874416413841792:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787583275.349253:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:2407:x1874416413841792:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 75us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583275.349260:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:1.0:1787583275.351291:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.351445:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413842048 00000100:00100000:2.0:1787583275.351453:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413842048 00000100:00100000:2.0:1787583275.351511:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:2.0:1787583275.351522:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909351693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+15:15664:x1874416413842048:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787583275.351579:0:20292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787583275.351614:0:20292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a000/0x19a47956376b7a7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46ee expref: 15 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.351633:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff909345181d00) 00010000:00010000:2.0:1787583275.351637:0:20292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583275.351663:0:20292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ac00/0x19a47956376b7a88 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.351675:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ac00/0x19a47956376b7a88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.351685:0:20292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ac00/0x19a47956376b7a88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787583275.351792:0:20292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000465ac7b1 reply state 00000000679e78f4 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ac00/0x19a47956376b7a88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.351804:0:20292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924770ac00/0x19a47956376b7a88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.351810:0:20292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff909345181d00) 00010000:00010000:2.0:1787583275.351813:0:20292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787583275.351815:0:20292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787583275.351932:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909351693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+16:15664:x1874416413842048:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 412us (648us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787583275.351939:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1787583275.353952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.354401:0:19228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413842176 00000100:00100000:2.0:1787583275.354410:0:19228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413842176 00000100:00100000:2.0:1787583275.354498:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1787583275.356064:0:19228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:15664:x1874416413842176:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787583275.356083:0:19228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787583275.356101:0:19228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c46fc expref: -99 pid: 19228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.356131:0:19228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0c87b48/0x19a47956376b7a81 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46f5 expref: 8 pid: 19228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.356140:0:19228:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583275.356144:0:19228:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583275.356150:0:19228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46fc expref: 8 pid: 19228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.356182:0:19228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0c87b48/0x19a47956376b7a81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46f5 expref: 8 pid: 19228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.356197:0:19228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0c87b48/0x19a47956376b7a81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46f5 expref: 8 pid: 19228 timeout: 682 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583275.356224:0:19228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19228:1874416435932928:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583275.356322:0:19228:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583275.359319:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1787583275.359406:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413842304 00000100:00100000:1.0:1787583275.359416:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413842304 00010000:00010000:1.0:1787583275.359454:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c87b48/0x19a47956376b7a81 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46f5 expref: 9 pid: 19228 timeout: 682 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583275.359503:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1787583275.359511:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+9:2406:x1874416413842304:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787583275.359521:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787583275.359536:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0c87b48/0x19a47956376b7a81 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46f5 expref: 9 pid: 19228 timeout: 682 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.359547:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0c87b48/0x19a47956376b7a81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46f5 expref: 9 pid: 19228 timeout: 682 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.359564:0:17140:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583275.359567:0:17140:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787583275.359572:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46fc expref: 9 pid: 19228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.359578:0:17140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46fc expref: 9 pid: 19228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.359614:0:17140:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46fc expref: 9 pid: 19228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583275.359634:0:17140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17140:1874416435933056:192.168.203.11@tcp:105: 00000100:00100000:1.0:1787583275.359701:0:17140:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936687b000 going to sleep for 11 seconds 00010000:00010000:2.0:1787583275.360289:0:19228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0c87b48/0x19a47956376b7a81 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46f5 expref: 9 pid: 19228 timeout: 682 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583275.360320:0:19228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19228:1874416435932928:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583275.360353:0:19228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46fc expref: 8 pid: 19228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.360364:0:19228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90924770a200, rc 0) 00000100:00100000:2.0:1787583275.360449:0:19228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+8:15664:x1874416413842176:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 4394us (6505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.360457:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:0.0:1787583275.363970:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.364380:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413842432 00000100:00100000:2.0:1787583275.364389:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413842432 00000100:00100000:1.0:1787583275.364412:0:17140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17140:1874416435933056:192.168.203.11@tcp:105: 00010000:00010000:1.0:1787583275.364434:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787583275.364468:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1787583275.364478:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909365998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+8:2407:x1874416413842432:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787583275.364543:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+8:2406:x1874416413842304:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 5032us (5232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583275.364554:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00002000:00010000:2.0:1787583275.364622:0:18661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787583275.364625:0:18661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787583274 00002000:00010000:2.0:1787583275.364628:0:18661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787583273 00002000:00010000:2.0:1787583275.364630:0:18661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787583274 -> 1787583274 00002000:00010000:2.0:1787583275.364633:0:18661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787583275.364658:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909365998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+8:2407:x1874416413842432:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 182us (699us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787583275.364665:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:1.0:1787583275.367543:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.367682:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413842560 00000100:00100000:2.0:1787583275.367691:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413842560 00000100:00100000:2.0:1787583275.367795:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:2.0:1787583275.367807:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+8:2406:x1874416413842560:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787583275.367876:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.367926:0:18660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46fc expref: 8 pid: 19228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.367934:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787583275.367939:0:18660:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787583275.367944:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.367990:0:18660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46fc expref: 8 pid: 19228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.368005:0:18660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46fc expref: 8 pid: 19228 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583275.368021:0:18660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18660:1874416435933184:192.168.203.11@tcp:104: 00000100:00100000:2.0:1787583275.368084:0:18660:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936f0be6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787583275.370939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1787583275.371692:0:18660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18660:1874416435933184:192.168.203.11@tcp:104: 00010000:00010000:2.0:1787583275.371720:0:18660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583275.372086:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413842688 00000100:00100000:0.0:1787583275.372095:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413842688 00010000:00010000:0.0:1787583275.372132:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46fc expref: 9 pid: 19228 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583275.372175:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1787583275.372186:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+9:2406:x1874416413842688:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787583275.372335:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787583275.372359:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46fc expref: 9 pid: 19228 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.372690:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46fc expref: 9 pid: 19228 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.372716:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092645deb/0x19a47956376b7a8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46fc expref: 9 pid: 19228 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.372733:0:17139:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583275.372738:0:17139:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787583275.372744:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.372753:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.372787:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787583275.372879:0:18660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583275.372891:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+8:2406:x1874416413842688:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 661us (1915us total) trans 0 rc 0/0 00010000:00010000:2.0:1787583275.372893:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583275.372904:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00010000:00010000:2.0:1787583275.372926:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.372936:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.372944:0:18660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.372951:0:18660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924770a000 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583275.372956:0:18660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.372965:0:18660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.372977:0:18660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.372985:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d0ff4ba/0x19a47956376b7a96 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583275.373035:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:2406:x1874416413842560:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 5229us (5501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583275.373054:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:1.0:1787583275.375925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583275.377162:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413842944 00000100:00100000:0.0:1787583275.377174:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413842944 00000100:00100000:0.0:1787583275.377242:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:0.0:1787583275.377252:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+16:15664:x1874416413842944:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787583275.377353:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.377369:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b79e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46bd expref: 16 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.377378:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.377413:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b79e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46bd expref: 16 pid: 20292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.377428:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b79e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46bd expref: 16 pid: 20292 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583275.377442:0:17155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352913100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1874416435933312:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583275.378542:0:17155:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465f53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787583275.381476:0:17155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352913100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1874416435933312:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583275.381507:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583275.382474:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583275.382590:0:20179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413843072 00000100:00100000:3.0:1787583275.382600:0:20179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413843072 00010000:00010000:3.0:1787583275.382637:0:20179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b79e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46bd expref: 17 pid: 20292 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583275.382675:0:20179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1787583275.382686:0:20179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+17:2406:x1874416413843072:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583275.382698:0:20179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583275.382751:0:20179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b79e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46bd expref: 17 pid: 20292 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.382768:0:20179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b79e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46bd expref: 17 pid: 20292 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.382789:0:20179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713ea00/0x19a47956376b79e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46bd expref: 17 pid: 20292 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.382824:0:20179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:3.0:1787583275.382830:0:20179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b7a03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46cb expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.382840:0:20179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.382889:0:20179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.382897:0:20179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.382922:0:20179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787583275.382968:0:17155:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583275.382977:0:20179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+16:2406:x1874416413843072:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 290us (505us total) trans 0 rc 0/0 00010000:00010000:0.0:1787583275.382981:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583275.382996:0:20179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00010000:00010000:0.0:1787583275.383622:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.383642:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a400/0x19a47956376b7a6c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46e7 expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.383651:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.383690:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a400/0x19a47956376b7a6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46e7 expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.383704:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a400/0x19a47956376b7a6c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46e7 expref: 16 pid: 17154 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583275.383718:0:17155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352913100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1874416435933440:192.168.203.11@tcp:104: 00000100:00100000:0.0:1787583275.383776:0:17155:0:(client.c:2715:ptlrpc_set_wait()) set ffff9092465f5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787583275.386736:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583275.386804:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413843200 00000100:00100000:3.0:1787583275.386812:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413843200 00010000:00010000:3.0:1787583275.386889:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a400/0x19a47956376b7a6c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46e7 expref: 17 pid: 17154 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787583275.386926:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1787583275.386937:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+17:2406:x1874416413843200:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787583275.386951:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787583275.386958:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a400/0x19a47956376b7a6c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46e7 expref: 17 pid: 17154 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.386987:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a400/0x19a47956376b7a6c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46e7 expref: 17 pid: 17154 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.387007:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff909345181d00) 00010000:00010000:3.0:1787583275.387010:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.387017:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.387022:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.387034:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787583275.387080:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+17:2406:x1874416413843200:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 146us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583275.387085:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00010000:00010000:0.0:1787583275.387527:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924770a400/0x19a47956376b7a6c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46e7 expref: 16 pid: 17154 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583275.387547:0:17155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352913100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1874416435933440:192.168.203.11@tcp:104: 00010000:00010000:0.0:1787583275.387567:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.387588:0:17155:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.387594:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787583275.387689:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787583275.387820:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787583275.387890:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787583275.387962:0:17155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352913100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17155:1874416435933568:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787583275.388009:0:17155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583275.388043:0:17155:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936687a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787583275.388085:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435933568 00000100:00100000:1.0:1787583275.388092:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435933568 00000100:00100000:1.0:1787583275.388132:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787583275.388141:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17155:x1874416435933568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787583275.388223:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17155:x1874416435933568:12345-0@lo:1000:mdt00_002.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583275.388229:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787583275.388315:0:17155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352913100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17155:1874416435933568:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787583275.388466:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787583275.388770:0:17155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909352913100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17155:1874416435933696:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787583275.388802:0:17155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583275.388830:0:17155:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936687a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787583275.389170:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435933696 00000100:00100000:2.0:1787583275.389176:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435933696 00000100:00100000:2.0:1787583275.389257:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787583275.389266:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909352910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17155:x1874416435933696:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787583275.389394:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909352910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17155:x1874416435933696:12345-0@lo:1000:mdt00_002.0 Request processed in 130us (591us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787583275.389401:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787583275.390306:0:17155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909352913100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17155:1874416435933696:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787583275.390344:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390355:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390362:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390368:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1e00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583275.390373:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390380:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390393:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff909345181d00) 00010000:00010000:0.0:1787583275.390396:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787583275.390414:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390421:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1e00/0x19a47956376b7aa4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390453:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b79fc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390460:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b79fc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390465:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b79fc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390471:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90924713fc00 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583275.390474:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b79fc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390480:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b79fc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390488:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:0.0:1787583275.390490:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787583275.390497:0:17155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b7a03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46cb expref: 19 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390508:0:17155:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b7a03 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46cb expref: 19 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390516:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b7a03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46cb expref: 19 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.390595:0:17155:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90924713f000/0x19a47956376b7a03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c46cb expref: 19 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583275.390608:0:17155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1874416435933824:192.168.203.11@tcp:105: 00000100:00100000:0.0:1787583275.390666:0:17155:0:(client.c:2715:ptlrpc_set_wait()) set ffff90936687a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787583275.394438:0:17155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1874416435933824:192.168.203.11@tcp:105: 00010000:00010000:0.0:1787583275.394464:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b79fc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394475:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90924713fc00/0x19a47956376b79fc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394509:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1000/0x19a47956376b7aab lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394523:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1000/0x19a47956376b7aab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394534:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1000/0x19a47956376b7aab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394545:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1000/0x19a47956376b7aab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394551:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1000/0x19a47956376b7aab lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394557:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1000/0x19a47956376b7aab lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394581:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f1000 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583275.394586:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1000/0x19a47956376b7aab lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394593:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1000/0x19a47956376b7aab lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394605:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:0.0:1787583275.394608:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787583275.394612:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1000/0x19a47956376b7aab lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394617:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f1000/0x19a47956376b7aab lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394629:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394636:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394642:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394647:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0600 already unused, calling callback (ffffffffc179e4f0) 00010000:00010000:0.0:1787583275.394650:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394656:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394674:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:0.0:1787583275.394677:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787583275.394680:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.394687:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0600/0x19a47956376b7a9d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583275.394870:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+19:15664:x1874416413842944:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 17618us (18953us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787583275.394881:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000020:00080000:0.0:1787583275.394887:0:17155:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787583275.395464:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583275.395541:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413843328 00000100:00100000:0.0:1787583275.395549:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413843328 00000040:00080000:2.0:1787583275.395905:0:17189:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787583275.395910:0:17189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787583275.395926:0:17189:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787583275.395932:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787583275.396095:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1787583275.396106:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90937fbecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+19:15663:x1874416413843328:12345-192.168.203.11@tcp:49:dd.0 00000100:00100000:0.0:1787583275.396349:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90937fbecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+19:15663:x1874416413843328:12345-192.168.203.11@tcp:49:dd.0 Request processed in 244us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583275.396357:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1787583275.398514:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583275.398594:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413843584 00000100:00100000:3.0:1787583275.398603:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413843584 00000100:00100000:3.0:1787583275.398659:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1787583275.398669:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+19:15664:x1874416413843584:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787583275.398940:0:17156:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787583275.400116:0:17156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00000100:00100000:2.0:1787583275.400127:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1787583275.400167:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b7ab2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.400188:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b7ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583275.400190:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413843712 00000100:00100000:0.0:1787583275.400196:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413843712 00000100:00100000:0.0:1787583275.400240:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:0.0:1787583275.400249:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+22:15663:x1874416413843712:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:0.0:1787583275.400265:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787583275.400279:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0a00/0x19a47956376b7ab9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13d50ad9d93c4703 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.400335:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0000/0x19a47956376b7ac0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.400347:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b7ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.400347:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0000/0x19a47956376b7ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.400367:0:17156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b7ab2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.400369:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0000/0x19a47956376b7ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.400384:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b7ab2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.400392:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b7ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.400415:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787583275.400484:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0a00/0x19a47956376b7ab9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4703 expref: 24 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.400514:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9092464f0000/0x19a47956376b7ac0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x13d50ad9d93c4703 expref: 23 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.400523:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff909345181e00) 00010000:00010000:0.0:1787583275.400526:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787583275.400530:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9092464f0000, rc 0) 00000100:00100000:0.0:1787583275.400585:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+23:15663:x1874416413843712:12345-192.168.203.11@tcp:101:dd.0 Request processed in 337us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583275.400593:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:3.0:1787583275.400600:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+23:15664:x1874416413843584:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 1930us (2091us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787583275.400610:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000020:00080000:3.0:1787583275.400615:0:17156:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787583275.400617:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787583275.400629:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b7ab2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.400635:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367e000 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:1.0:1787583275.400639:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b7ab2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.400647:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b7ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.400659:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff909345181d00) 00010000:00010000:1.0:1787583275.400662:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787583275.400666:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b7ab2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.400672:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90936367e000/0x19a47956376b7ab2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787583275.400688:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583275.400689:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787583275.400691:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787583275.550981:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1787583275.551095:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413843840 00000100:00100000:0.0:1787583275.551106:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413843840 00000100:00100000:0.0:1787583275.551173:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:0.0:1787583275.551184:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9092473c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:2407:x1874416413843840:12345-192.168.203.11@tcp:4:dd.0 00002000:00010000:0.0:1787583275.551229:0:18664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a8c5b2a, atime: 0x6a8c5b29, ctime: 0x6a8c5b2a, blocks: 0x0 00010000:00010000:0.0:1787583275.551238:0:18664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f64b140/0x19a47956376b7ac7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.551265:0:18664:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=582s v=(0 0) 00010000:00010000:0.0:1787583275.551270:0:18664:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787583275.551277:0:18664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f64b140/0x19a47956376b7ac7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.551304:0:18664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f64b140/0x19a47956376b7ac7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787583275.554673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1787583275.554864:0:18666:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787583275.554875:0:18666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787583275.555112:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416413843968 00000100:00100000:1.0:1787583275.555121:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416413843968 00000100:00100000:3.0:1787583275.556375:0:20294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:3.0:1787583275.556391:0:20294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+8:2407:x1874416413843968:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:3.0:1787583275.556427:0:20294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bb28bee/0x19a47956376b7ace lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.556445:0:20294:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583275.556450:0:20294:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787583275.556457:0:20294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bb28bee/0x19a47956376b7ace lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787583275.556484:0:20294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bb28bee/0x19a47956376b7ace lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787583275.641483:0:18655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1787583275.641502:0:18655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1787583275.641882:0:18664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1787583275.641888:0:18664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1787583275.641921:0:18664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f64b140/0x19a47956376b7ac7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.641947:0:18664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f64b140/0x19a47956376b7ac7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.641957:0:18664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f64b140/0x19a47956376b7ac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.641965:0:18664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9092464f0a00 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:2.0:1787583275.642003:0:18664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f64b140/0x19a47956376b7ac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.642036:0:18664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f64b140/0x19a47956376b7ac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.642072:0:18664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f64b140/0x19a47956376b7ac7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787583275.642081:0:18664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f64b140/0x19a47956376b7ac7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787583275.642266:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9092473c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+7:2407:x1874416413843840:12345-192.168.203.11@tcp:4:dd.0 Request processed in 91067us (91278us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787583275.642304:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000001:00080000:3.0:1787583275.683404:0:18655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1787583275.683994:0:20294:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1787583275.684001:0:20294:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1787583275.684714:0:20294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bb28bee/0x19a47956376b7ace lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.684741:0:20294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bb28bee/0x19a47956376b7ace lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.684751:0:20294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bb28bee/0x19a47956376b7ace lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.684758:0:20294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90936367f400 already unused, calling callback (ffffffffc0b91230) 00010000:00010000:0.0:1787583275.684763:0:20294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bb28bee/0x19a47956376b7ace lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.684772:0:20294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bb28bee/0x19a47956376b7ace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.684808:0:20294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bb28bee/0x19a47956376b7ace lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787583275.684816:0:20294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bb28bee/0x19a47956376b7ace lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787583275.684986:0:20294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2fe92cb2-a1f3-4fc5-beed-1773d3bb3c77+5:2407:x1874416413843968:12345-192.168.203.11@tcp:4:dd.0 Request processed in 128595us (130316us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787583275.684997:0:20294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00010000:00010000:1.0:1787583275.854117:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787583276.494815:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787583276.494838:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435933952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787583276.494927:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583276.495085:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435933952 00000100:00100000:2.0:1787583276.495092:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435933952 00000100:00100000:2.0:1787583276.495155:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787583276.495165:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435933952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787583276.495186:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:2.0:1787583276.495231:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874416435933952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583276.495237:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787583276.495515:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583276.495550:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874416435933952:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787583276.877985:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787583277.157196:0:20331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1787583277.520514:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435934208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787583277.520585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583277.520634:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787583277.520641:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435934080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787583277.520665:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583277.520741:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435934208 00000100:00100000:0.0:1787583277.520749:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435934208 00000100:00100000:0.0:1787583277.520808:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435934080 00000100:00100000:0.0:1787583277.520811:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435934080 00000100:00100000:0.0:1787583277.520827:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787583277.520836:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435934208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787583277.520886:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787583277.520934:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435934208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583277.520941:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787583277.520957:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787583277.520963:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff909247ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435934080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787583277.520979:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787583277.521004:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff909247ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874416435934080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 42us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583277.521036:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787583277.521076:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874416435934080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787583277.521087:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435934208:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787583277.902285:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787583278.287532:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787583278.544936:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435934336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787583278.545010:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583278.545073:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435934336 00000100:00100000:0.0:1787583278.545081:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435934336 00000100:00100000:0.0:1787583278.545145:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787583278.545155:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435934336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787583278.545184:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787583278.545227:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874416435934336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787583278.545234:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787583278.545254:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787583278.545380:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435934592:0@lo:400:kworker.0 00000100:00100000:0.0:1787583278.545407:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583278.545433:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435935104:0@lo:400:kworker.0 00000100:00100000:0.0:1787583278.545450:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583278.545464:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435935616:0@lo:400:kworker.0 00000100:00100000:0.0:1787583278.545484:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583278.545498:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787583278.545503:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435934720:0@lo:400:kworker.0 00000100:00100000:0.0:1787583278.545519:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583278.545556:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435935232:0@lo:400:kworker.0 00000100:00100000:0.0:1787583278.545575:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787583278.545592:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435935744:0@lo:400:kworker.0 00000100:00100000:0.0:1787583278.545609:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583278.547258:0:19228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435935104 00000100:00100000:1.0:1787583278.547268:0:19228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435935104 00000100:00100000:1.0:1787583278.547333:0:19228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435934720 00000100:00100000:1.0:1787583278.547336:0:19228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435934720 00000100:00100000:1.0:1787583278.547358:0:19228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435935232 00000100:00100000:1.0:1787583278.547361:0:19228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435935232 00000100:00100000:1.0:1787583278.547379:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787583278.547387:0:19228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435935104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.547454:0:19228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435935104:12345-0@lo:400:kworker.0 Request processed in 68us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583278.547460:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787583278.547474:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787583278.547480:0:19228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435934720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.547507:0:19228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435934720:12345-0@lo:400:kworker.0 Request processed in 27us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583278.547512:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787583278.547522:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787583278.547599:0:19228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435935232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.547691:0:19228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874416435935232:12345-0@lo:400:kworker.0 Request processed in 95us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583278.547698:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787583278.547717:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435934592 00000100:00100000:1.0:1787583278.547720:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435934592 00000100:00100000:1.0:1787583278.547747:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787583278.547754:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435934592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.547786:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874416435934592:12345-0@lo:400:kworker.0 Request processed in 34us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583278.547804:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787583278.547822:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787583278.547833:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff909247ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435936128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787583278.547886:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583278.547924:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435934464:0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.547951:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583278.547977:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435934976:0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.547999:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583278.549702:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435935488:0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.549775:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435934976 00000100:00100000:1.0:1787583278.549782:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435934976 00000100:00100000:1.0:1787583278.549834:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787583278.549842:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435934976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.549912:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874416435934976:12345-0@lo:400:kworker.0 Request processed in 71us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583278.549919:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787583278.549940:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787583278.549944:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787583278.549960:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435934848:0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.549990:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435936128 00000100:00100000:1.0:1787583278.549994:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435936128 00000100:00100000:1.0:1787583278.550034:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787583278.550041:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435936128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787583278.550716:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787583278.550771:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874416435936128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 729us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583278.550792:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787583278.550869:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff909247ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874416435936128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787583278.551762:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435934592:0@lo:400:kworker.0 00000100:00100000:0.0:1787583278.551778:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435935104:0@lo:400:kworker.0 00000100:00100000:0.0:1787583278.551798:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1787583278.551803:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9093668a1880, transno 8589934596 00000004:00080000:0.0:1787583278.551811:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1787583278.551825:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874416435934720:0@lo:400:kworker.0 00000100:00100000:0.0:1787583278.551836:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874416435935232:0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.552793:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787583278.552839:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435935616 00000100:00100000:2.0:1787583278.552855:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435935616 00000100:00100000:2.0:1787583278.552909:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435935744 00000100:00100000:2.0:1787583278.552911:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435935744 00000100:00100000:2.0:1787583278.552930:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787583278.552938:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435935616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583278.553024:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874416435935616:12345-0@lo:400:kworker.0 Request processed in 86us (7538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583278.553031:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787583278.553046:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787583278.553052:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093668a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435935744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583278.553074:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093668a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874416435935744:12345-0@lo:400:kworker.0 Request processed in 24us (7464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583278.553080:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787583278.553111:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435934464 00000100:00100000:2.0:1787583278.553124:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435934464 00000100:00100000:2.0:1787583278.553151:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787583278.553157:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093524d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+24:3656:x1874416435934464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583278.553187:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093524d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea761437-c095-48a5-91f7-0c431111ca6a+24:3656:x1874416435934464:12345-0@lo:400:kworker.0 Request processed in 30us (5235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583278.553193:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1787583278.553225:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787583278.553228:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787583278.553255:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874416435935744:0@lo:400:kworker.0 00010000:00080000:2.0:1787583278.553278:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9093669cf800 x1874416435935616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787583278.553290:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874416435935616:0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.566890:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435935360:0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.566951:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583278.566974:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9093669cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435935872:0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.566995:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787583278.567117:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435934848 00000100:00100000:3.0:1787583278.567125:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435934848 00000100:00100000:3.0:1787583278.567172:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435935360 00000100:00100000:3.0:1787583278.567176:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435935360 00000100:00100000:3.0:1787583278.567194:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435935872 00000100:00100000:3.0:1787583278.567197:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435935872 00000100:00100000:3.0:1787583278.567223:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787583278.567232:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435934848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787583278.567344:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787583278.567352:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435935360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583278.568905:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874416435934848:12345-0@lo:400:kworker.0 Request processed in 1670us (16111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583278.568916:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787583278.568946:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787583278.568957:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435935872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583278.568994:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874416435935872:12345-0@lo:400:kworker.0 Request processed in 40us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583278.569006:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787583278.569040:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787583278.575680:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9093669cdf80 x1874416435935872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787583294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787583278.575707:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874416435935872:0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.575734:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874416435934336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787583278.575771:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874416435934848:0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.575804:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583278.575880:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435936000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787583278.575931:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787583278.575961:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea761437-c095-48a5-91f7-0c431111ca6a:3656:1874416435934464:0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.575973:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874416435934976:0@lo:400:kworker.0 00000100:00100000:1.0:1787583278.575995:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435936000 00000100:00100000:1.0:1787583278.576000:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435936000 00000100:00100000:1.0:1787583278.576043:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787583278.576054:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435936000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787583278.576091:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787583278.576144:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874416435936000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787583278.576151:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787583278.576188:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9092473c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874416435936000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787583278.576323:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416435935488 00000100:00100000:3.0:1787583278.576327:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416435935488 00000100:00100000:3.0:1787583278.576374:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787583278.576380:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9093669c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435935488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787583278.576418:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874416435935488:12345-0@lo:400:kworker.0 Request processed in 39us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787583278.576424:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787583278.576928:0:17149:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787583278.576952:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874416435935488:0@lo:400:kworker.0 00000100:00100000:2.0:1787583278.578835:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9093669caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874416435935360:12345-0@lo:400:kworker.0 Request processed in 11476us (11876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787583278.578879:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787583278.583742:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9093669cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874416435935360:0@lo:400:kworker.0 Debug log: 42040 lines, 42040 kept, 0 dropped, 0 bad.